How to Build, Evaluate, and Iterate on LLM Agents

2023/12/06 に公開
視聴回数 28,369
0
0
LLM Agents are one of the most in-demand uses of large language models. This workshop, led by the expert founders of LlamaIndex and TruEra, will show you how to develop, evaluate, and iterate LLM Agents, so that you can build powerful, effective LLM Agents quickly.


In this workshop, you will learn:

How to use a framework like LlamaIndex to build your LLM Agent
How to evaluate your LLM Agent using open source LLM Observability tools like TruLens - testing for effectiveness, hallucinations, and bias
How to iterate your way to an effective app that will be approved for production
What to do to keep your app high performing in production

Slides:
https://docs.google.com/presentation/d/1gnXhucgiI7I7enBDSGmvTmLqKvs3zZIKWyjf0bsydsc/edit?usp=sharing

Notebook:
https://colab.research.google.com/github/truera/trulens/blob/main/trulens_eval/examples/expositional/frameworks/llama_index/llama_index_agents.ipynb


This event is inspired by DeepLearning.AI’s GenAI short courses, created in collaboration with AI companies across the globe. Our courses help you learn new skills, tools, and concepts efficiently within 1 hour.

https://bit.ly/41arJ59


About LlamaIndex

LlamaIndex is a simple, flexible data framework for connecting custom data sources to large language models. https://www.llamaindex.ai/

About TruEra

TruEra is a leader in AI Observability, providing solutions for monitoring, testing, and debugging both predictive and generative AI. It also offers the free, open source TruLens library for testing and tracking LLM app experiments. www.truera.com



Speakers:

Jerry Liu, CEO, LllamaIndex

https://www.linkedin.com/in/jerry-liu-64390071/

Anupam Datta, President and Chief Scientist, TruEra

https://www.linkedin.com/in/anupamdatta/