Get in Touch
 Duration 21 hours

Course Outline

Introduction to Large Language Models (LLMs)

  • Overview of LLMs
  • Definitions and industry significance
  • Current AI applications

Transformer Architecture

  • The mechanics of transformers
  • Key components and characteristics
  • Embedding and positional encoding
  • Multi-head attention
  • Feed-forward neural networks
  • Normalization and residual connections

Transformer Models

  • The self-attention mechanism
  • Encoder-decoder structures
  • Positional embeddings
  • BERT (Bidirectional Encoder Representations from Transformers)
  • GPT (Generative Pretrained Transformer)

Performance Optimization and Challenges

  • Managing context length
  • Mamba and state-space models
  • Flash attention
  • Sparse transformers
  • Vision transformers
  • The role of quantization

Enhancing Transformer Capabilities

  • Retrieval-augmented text generation
  • Mixture of models
  • Tree of thoughts

Fine-Tuning

  • Theory behind low-rank adaptation
  • Fine-tuning using QLora

Scaling Laws and Optimization in LLMs

  • The significance of scaling laws for LLMs
  • Scaling data and model size
  • Computational scaling
  • Parameter efficiency scaling

Optimization

  • Interplay between model size, data volume, compute budget, and inference needs
  • Improving LLM performance and efficiency
  • Best practices and tools for LLM training and fine-tuning

Training and Fine-Tuning LLMs

  • Process and hurdles of training LLMs from scratch
  • Data acquisition and upkeep
  • Resource requirements for large-scale data, CPU, and memory
  • Optimization difficulties
  • The landscape of open-source LLMs

Fundamentals of Reinforcement Learning (RL)

  • Overview of Reinforcement Learning
  • Learning via positive reinforcement
  • Core concepts and definitions
  • Markov Decision Process (MDP)
  • Dynamic programming
  • Monte Carlo methods
  • Temporal Difference Learning

Deep Reinforcement Learning

  • Deep Q-Networks (DQN)
  • Proximal Policy Optimization (PPO)
  • Core elements of Reinforcement Learning

Integrating LLMs and Reinforcement Learning

  • Synergizing LLMs with RL
  • The role of RL in LLM development
  • Reinforcement Learning from Human Feedback (RLHF)
  • Alternatives to RLHF

Case Studies and Applications

  • Real-world use cases
  • Success stories and associated challenges

Advanced Topics

  • Advanced methodologies
  • Sophisticated optimization techniques
  • Frontier research and emerging developments

Summary and Next Steps

Requirements

  • A solid foundation in Machine Learning

Target Audience

  • Data scientists
  • Software engineers

Custom Corporate Training

Training solutions designed exclusively for businesses.

  • Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
  • Flexible Schedule: Dates and times adapted to your team's agenda.
  • Format: Online (live), In-company (at your offices), or Hybrid.
Investment

Price per private group, online live training, starting from 4350 € + VAT*

Contact us for an exact quote and to hear our latest promotions

Upcoming Courses

Related Categories