Intermediate course
Master RAG: Ultimate Retrieval-Augmented Generation Course
Learn RAG for LLMs and Advanced Retrieval Techniques | LangChain and Embeddings | Multi-Agent RAG | RAG Pipelines
Intermediate
Course facts
- Last updated 12/2024
- Instructor: Sandra L. Sorel, Ligency
- retrieval-augmented generation and knowledge systems
What you'll learn
Practical outcomes
- Understand the Fundamentals of Retrieval-Augmented Generation (RAG)
- Explore advanced techniques to optimize and fine-tune the RAG pipeline
- Experiment with the levels of Text splitting (simple to complex) with examples to improve the retrieval process
- Learn to handle multiple document types to prep data for the LLM (unstructured(dot)io)
- Experiment with text splitters, Chunking strategies and optimization techniques
- Develop a comprehensive project: A multi-agent LLM-driven application using LangGraph
- Enhance RAG systems with pre-retrieval and post-retrieval optimization techniques and learn retrieval optimization with Query Transformation and Decomposition
Curriculum
7 sections • 62 lectures • 4h 55m total length
Introduction5 lectures • 19min
- Skills & Project requirements03:14
- Development Environment Setup & Course Files03:55
- Download the Starter Project00:16
- Integrate OpenAI into a Web Project (Quickstart)05:50
- Integrate OpenAI into a Web Project (Quickstart) : send first API request05:54
RAG : from Native (101) to Advanced - Pre-Indexing, Re-Ranking, Summarization19 lectures • 1hr 27min
- Introduction01:22
- OpenAI Setup & Configuration : step-by-step Guide00:20
- Starter project : Installation & Setup04:36
- Retrieval QA Integration (FAISS)04:17
- How to instantiate a ChatOpenAI model ?00:21
- Retrieval QA integration : Retriever and Generate components09:52
- Vector Stores (LangChain) & Embeddings explained00:33
- The Main Building Blocks02:50
- Build an End-2-End RAG Pipeline (ChromaDB)08:38
- Split Documents into Chunks00:21
- Build an End-2-End RAG Pipeline (ChromaDB) - Part 209:48
- Interactive playground (Google Colab) : Instructions00:14
- Interactive playground (Google Colab): With or Without RAG08:43
- Basic RAG Assessment 3 questions
- Advanced Techniques to Enhance the RAG pipeline05:00
- Download the Course Materials00:36
- [Part 1/4]-Advanced RAG : Query Translation and Enhancement (Decomposition)09:50
- [Part 2/4]-Advanced RAG : Query Decomposition and Enhancement - Answer queries09:42
- [Part 3/4] - Advanced RAG : Query Decomposition and Enhancement - Optimized Answ04:11
- [Part 4/4]-Advanced RAG : Query Decomposition and Enhancement05:36
Advanced RAG techniques & strategies12 lectures • 1hr 1min
- Introduction00:49
- Presentation & Setup00:22
- [Part 1/2] - Advanced RAG : multi-querying, retrieve and consolidate results09:32
- [Part 2/2] - Advanced RAG : multi-querying and generate accurate answers05:54
- Advanced RAG : RAG-Fusion00:06
- [Part 1/2] - Advanced RAG Fusion - multi-querying and reranking results04:51
- [Part 2/2] - Advanced RAG Fusion - generate context-aware responses04:56
- Advanced RAG : Corrective RAG (CRAG)00:07
- [Part 1/4] - Advanced RAG : Corrective RAG08:08
- [Part 2/4] - Advanced RAG : Corrective RAG - Retrieval Evaluator08:02
- [Part 3/4] - Advanced RAG : Corrective RAG - Rewrite & web tool08:05
- [Part 4/4] - Advanced RAG : Corrective RAG - generate response10:34
- Advanced RAG Quiz 3 questions
Optimized RAG : Document Transformers & Chunking Strategies10 lectures • 55min
- Section intro : Smart Text Division with LangChain02:00
- Level 1 - Split documents by Character vs. Recursively07:04
- Understanding the CharacterTextSplitter Parameters (Online tool : ChunkViz)00:02
- Level 2 - Split documents by character vs. recursively05:53
- Levels 3 - Document specific splitting : split code and markup06:56
- Levels 3 - Document-specific splitting : Code Splitting (Python)08:48
- Levels 3 - Document-specific splitting : PDF (unstructured.io)09:00
- Levels 3 - Document-specific splitting : extract and process elements from PDF d06:03
- Other Types of TextSplitters01:26
- Levels 4 & 5- Semantic Chunking (Embeddings-based) & Agentic approach07:57
- Text Splitters Quiz 1 question
LangSmith: Debug, Test, and Monitor LLM Applications3 lectures • 15min
- Introduction00:57
- RAG Implementation Tracing & Testing09:46
- Integrating LangSmith into your workflow04:33
From Native, to Advanced to Agentic RAG (LangGraph)8 lectures • 41min
- Introduction01:09
- Getting Started : Agent-based Workflow with LangGraph07:52
- Getting Started : Compile and Run the App (with Streamlit)07:47
- Agentic RAG : Build a Multi-agent Workflow as Graph00:26
- Define the Nodes10:28
- Define the Edges02:14
- Build the Workflow with Langraph03:32
- Compile and Run the Workflow07:32
Enhanced RAG quality - Conventional vs. Structured RAG (unstructured.io, GPT-4)5 lectures • 17min
- INTRO - Semi-structured RAG : to manage multiple data sources and content01:40
- Extract elements from PDF : tables, images...04:55
- Describe images with GPT-4 Vision07:57
- Process data sources into documents, index, retrieve and generate with LLM01:37
- [BONUS] - To Continue Your Learning Journey00:37
Who it is for
- Python developers & ML Engineers who want to build AI-driven applications leveraging LLMs
- Students and Learners willing to dive into RAG implementations and gain hands-on experience with practical examples
- Tech Entrepreneurs and AI Enthusiasts seeking new learning and business opportunities in AI
Course description
Overview
Welcome to "Master RAG: Ultimate Retrieval-Augmented Generation Course"! This course is a deep dive into the world of Retrieval-Augmented Generation (RAG) systems. If you aim to build powerful AI-driven applications and leverage language models, this course is for you! Perfect for anyone wanting to master the skills needed to develop intelligent retrieval-based applications. This hands-on course will guide you through the core concepts of RAG architecture, explore various frameworks, and provide a thorough understanding and practical experience in building advanced RAG systems. Enroll now and take the first step towards mastering RAG systems! # What You'll Learn: Development of LLM-based applications: Understand the core concepts and capabilities of Large Language Models (LLMs) and explore high-level frameworks that facilitate powered by retrieval and generation tasks, Optimizing and Scaling RAG Pipelines: Learn best practices for optimizing and scaling RAG pipelines using LangChain, including indexing, chunking, and retrieval optimization techniques, Advanced RAG Techniques: Enhance RAG systems with pre-retrieval and post-retrieval optimization techniques and learn retrieval optimization with query transformation and decomposition, Document Transformers and Chunking Strategies: Understand strategies for smart text division, handling large datasets, and improving document indexing and embeddings. Debugging, Testing, and Monitoring LLM Applications: Use LangSmith to debug, test, and monitor LLM applications, evaluating each component of the RAG pipeline. Building Multi-Agent LLM-Driven Applications: Develop complex stateful applications using LangGraph, making multiple agents collaborate on data retrieval and generation tasks. Enhanced RAG Quality: Learn to process unstructured data, extract elements like tables and images from PDF files, and integrate GPT-4 Vision to identify and describe elements within images. # What is Included? 1. Getting Started: Introduction and Setup Python Development Environment Setup Implement basic to advanced RAG pipelines Quickstart: Building Your First LLM-Powered Application using OpenAI Step-by-step OpenAI Guide to creating a basic application integrating the ChatOpenAI API for text and message generation 2. RAG: From Native (101) to Advanced RAG Key benefits and limitations of using LLMs Overview and understanding of the RAG pipeline and multiple use cases Hands-on project: Implement a basic RAG Q&A system using LLMs, LangChain, and the FAISS vector database [Project] - Build end-to-end RAG solutions using tools like FAISS and ChromaDB 3. Advanced RAG Techniques & Strategies Enhance RAG systems with pre-retrieval and post-retrieval optimization techniques Indexing and chunking optimization techniques Retrieval optimization with query transformation and decomposition 4. Optimized RAG: Document Transformers & Chunking Strategies Strategies for smart text division to handle large datasets and scaling applications Improve document indexing and embeddings Experiment with commonly used text splitters: Split into chunks by characters with a fixed-size parameter Split recursively by character Semantic chunking with LangChain to split into sentences based on text similarity 5. LangSmith: Debug, Test, and Monitor LLM Applications Evaluate each component of the RAG pipeline Develop a comprehensive project: A multi-agent LLM-driven application using LangGraph 6. Enhanced RAG Quality: Conventional vs. Structured RAG Learn to process unstructured data to facilitate integration and preparation for LLMs Practice with a project aimed at extracting elements like tables and images from PDF files and integrating GPT-4 Vision to identify and describe elements within images Bonus materials: Assessment questions, downloadable resources, interactive playgrounds (Google Colab) # Who is This Course For? Python Developers: Individuals who want to build AI-driven applications leveraging language models using high-level libraries and APIs ML Engineers: Professionals looking to enhance their skills in RAG techniques Students and Learners: Individuals eager to dive into the world of RAG systems and gain hands-on experience with practical examples Tech Entrepreneurs and AI Enthusiasts: Anyone seeking to create intelligent, retrieval-based applications and explore new business opportunities in AI Whether you’re a beginner or an advanced practitioner, this course will elevate your capabilities in constructing intelligent and efficient RAG pipelines with case studies and real-world examples. This course offers a comprehensive guide through the main concepts of RAG architecture, providing a structured learning path from basic to advanced techniques, ensuring a robust understanding to gain practical experience in building LLM-powered apps. Start your learning journey today and transform the way you develop retrieval-based applications!
Instructor
Sandra L. Sorel, Ligency
Sandra L. Sorel Software Developer (Javascript | ReactJS | DApp | Web3 | AI) Hello I am Sandy, freelance web and mobile Developer based out of Toronto, in Ontario, Canada, I specialize in Front-End development with HTML, CSS, CSS3 Animation, Sass, Javascript and JQuery. I love creating beautiful, professional and user-friendly websites using the Adobe Creative Suite: Photoshop, Illustrator and Flash to name a few. I am also keen on Web marketing, Web analytics, Visual Design, Video Editing, Photography and WordPress development. On top of being a Udemy instructor, I am an avid learner of new technologies and digital stuff. ***************************** Bonjour, Je suis Sandy, développeur javascript. Je suis passionnée de développement Front (HTML, CSS, CSS3 Animation, Sass, Javascript et ReactJS...). Mes autres intérêts sont le graphisme et motion design. Je suis également passionnée de conception visuelle, montage vidéo, photographie et gaming. Venez rejoindre ma communauté de 20k+ apprenants. Je publie régulièrement pour enrichir mon catalogue de nouveaux contenus. Depuis 2014, je partage mes connaissances, aussi bien en français qu'en anglais, sur les technologies Front et javascript qui ne cessent d'évoluer et d'offrir de nouvelles fonctionnalités pour faciliter notre réussite dans ce beau métier du développement et de la transformation digitale. Salutations !
