Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 21 hours
Course Outline
Introduction to Large Language Models (LLMs)
- Overview of LLMs
- Definitions and industry significance
- Current AI applications
Transformer Architecture
- The mechanics of transformers
- Key components and characteristics
- Embedding and positional encoding
- Multi-head attention
- Feed-forward neural networks
- Normalization and residual connections
Transformer Models
- The self-attention mechanism
- Encoder-decoder structures
- Positional embeddings
- BERT (Bidirectional Encoder Representations from Transformers)
- GPT (Generative Pretrained Transformer)
Performance Optimization and Challenges
- Managing context length
- Mamba and state-space models
- Flash attention
- Sparse transformers
- Vision transformers
- The role of quantization
Enhancing Transformer Capabilities
- Retrieval-augmented text generation
- Mixture of models
- Tree of thoughts
Fine-Tuning
- Theory behind low-rank adaptation
- Fine-tuning using QLora
Scaling Laws and Optimization in LLMs
- The significance of scaling laws for LLMs
- Scaling data and model size
- Computational scaling
- Parameter efficiency scaling
Optimization
- Interplay between model size, data volume, compute budget, and inference needs
- Improving LLM performance and efficiency
- Best practices and tools for LLM training and fine-tuning
Training and Fine-Tuning LLMs
- Process and hurdles of training LLMs from scratch
- Data acquisition and upkeep
- Resource requirements for large-scale data, CPU, and memory
- Optimization difficulties
- The landscape of open-source LLMs
Fundamentals of Reinforcement Learning (RL)
- Overview of Reinforcement Learning
- Learning via positive reinforcement
- Core concepts and definitions
- Markov Decision Process (MDP)
- Dynamic programming
- Monte Carlo methods
- Temporal Difference Learning
Deep Reinforcement Learning
- Deep Q-Networks (DQN)
- Proximal Policy Optimization (PPO)
- Core elements of Reinforcement Learning
Integrating LLMs and Reinforcement Learning
- Synergizing LLMs with RL
- The role of RL in LLM development
- Reinforcement Learning from Human Feedback (RLHF)
- Alternatives to RLHF
Case Studies and Applications
- Real-world use cases
- Success stories and associated challenges
Advanced Topics
- Advanced methodologies
- Sophisticated optimization techniques
- Frontier research and emerging developments
Summary and Next Steps
Requirements
- A solid foundation in Machine Learning
Target Audience
- Data scientists
- Software engineers
Custom Corporate Training
Training solutions designed exclusively for businesses.
- Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
- Flexible Schedule: Dates and times adapted to your team's agenda.
- Format: Online (live), In-company (at your offices), or Hybrid.
Price per private group, online live training, starting from 4350 € + VAT*
Contact us for an exact quote and to hear our latest promotions