Llama 2 in LangChain — FIRST Open Source Conversational Agent!

James Briggs
Llama 2 in LangChain — FIRST Open Source Conversational Agent!
  • 1 hours
  • Beginner
  • Free
  • Online
Llama 2 is the best-performing open-source Large Language Model (LLM) to date. In this video, we discover how to use the 70B parameter model fine-tuned for chat (Llama 2 70B Chat) using Hugging Face transformers and LangChain. We will see how to apply Llama 2 as a conversational agent within LangChain.

00:00 Llama 2 Model

02:55 Getting Access to Llama 2

06:12 Initializing Llama 2 70B with Hugging Face

08:17 Quantization and GPU Memory Requirements

11:14 Loading Llama 2

13:05 Stopping Criteria

15:17 Initializing Text Generation Pipeline

16:25 Loading Llama 2 in LangChain

17:08 Creating Llama 2 Conversational Agent

19:46 Prompt Engineering with Llama 2 Chat

22:16 Llama 2 Conversational Agent

24:14 Future of Open Source LLMs

Sign up Course