Get in Touch
 Duration 14 hours

Course Outline

Introduction to Retrieval-Augmented Generation (RAG)

  • Defining RAG and its significance in enterprise AI.
  • Key components: retriever, generator, and document store.
  • Comparing RAG with standalone LLMs and vector search methods.

Setting Up a RAG Pipeline

  • Installation and configuration of frameworks like Haystack.
  • Managing document ingestion and preprocessing.
  • Integrating retrievers with vector databases such as FAISS and Pinecone.

Fine-Tuning the Retriever

  • Training dense retrievers on domain-specific data.
  • Leveraging sentence transformers and contrastive learning.
  • Assessing retriever effectiveness using top-k accuracy metrics.

Fine-Tuning the Generator

  • Choosing appropriate base models (e.g., BART, T5, FLAN-T5).
  • Distinguishing between instruction tuning and supervised fine-tuning.
  • Utilizing LoRA and PEFT methods for efficient model updates.

Evaluation and Optimization

  • Using key metrics to measure RAG performance (e.g., BLEU, EM, F1).
  • Addressing latency, retrieval quality, and hallucination reduction.
  • Tracking experiments and driving iterative improvements.

Deployment and Real-World Integration

  • Implementing RAG in internal search engines and chatbots.
  • Navigating security, data access, and governance requirements.
  • Integrating with APIs, dashboards, or knowledge portals.

Case Studies and Best Practices

  • Exploring enterprise applications in finance, healthcare, and legal sectors.
  • Strategies for managing domain drift and knowledge base updates.
  • Insights into future trends in retrieval-augmented LLM systems.

Summary and Next Steps

Requirements

  • A solid grasp of natural language processing (NLP) fundamentals.
  • Practical experience with transformer-based language models.
  • Proficiency in Python and an understanding of basic machine learning workflows.

Target Audience

  • NLP engineers.
  • Knowledge management teams.

Custom Corporate Training

Training solutions designed exclusively for businesses.

  • Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
  • Flexible Schedule: Dates and times adapted to your team's agenda.
  • Format: Online (live), In-company (at your offices), or Hybrid.
Investment

Price per private group, online live training, starting from 2900 € + VAT*

Contact us for an exact quote and to hear our latest promotions

Upcoming Courses

Related Categories