Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 14 hours
Course Outline
Introduction to Open-Source LLMs
- Defining open-weight models and their strategic significance
- Surveying LLaMA, Mistral, Qwen, and other community-driven models
- Application scenarios for private, on-premise, or secure infrastructures
Setting Up the Environment and Tools
- Installing and configuring Transformers, Datasets, and PEFT libraries
- Selecting suitable hardware for the fine-tuning process
- Retrieving pre-trained models from Hugging Face or alternative repositories
Data Curation and Preprocessing
- Dataset structures (instruction tuning, conversational data, plain text)
- Tokenization strategies and sequence handling
- Developing bespoke datasets and data loaders
Fine-Tuning Methodologies
- Contrasting standard full fine-tuning with parameter-efficient approaches
- Implementing LoRA and QLoRA for efficient model adaptation
- Leveraging the Trainer API for rapid experimentation
Evaluating and Optimizing Models
- Measuring specialized models using generation quality and accuracy indicators
- Mitigating overfitting and managing generalization and validation sets
- Best practices for performance tuning and logging
Deployment and Enterprise Usage
- Storing and retrieving models for inference tasks
- Releasing specialized models within secure corporate environments
- Comparing on-premise versus cloud-based deployment tactics
Real-World Case Studies and Applications
- Practical examples of enterprise adoption of LLaMA, Mistral, and Qwen
- Managing multilingual and domain-specific adaptations
- Discussion: Balancing trade-offs between open and closed models
Wrap-Up and Future Directions
Requirements
- Familiarity with large language models (LLMs) and their underlying architecture
- Proficiency in Python and PyTorch
- Foundational knowledge of the Hugging Face ecosystem
Target Audience
- Machine Learning Professionals
- AI Developers
Custom Corporate Training
Training solutions designed exclusively for businesses.
- Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
- Flexible Schedule: Dates and times adapted to your team's agenda.
- Format: Online (live), In-company (at your offices), or Hybrid.
Price per private group, online live training, starting from 2900 € + VAT*
Contact us for an exact quote and to hear our latest promotions