Get in Touch
 Duration 14 hours

Course Outline

Introduction to Open-Source LLMs

  • Defining open-weight models and their strategic significance
  • Surveying LLaMA, Mistral, Qwen, and other community-driven models
  • Application scenarios for private, on-premise, or secure infrastructures

Setting Up the Environment and Tools

  • Installing and configuring Transformers, Datasets, and PEFT libraries
  • Selecting suitable hardware for the fine-tuning process
  • Retrieving pre-trained models from Hugging Face or alternative repositories

Data Curation and Preprocessing

  • Dataset structures (instruction tuning, conversational data, plain text)
  • Tokenization strategies and sequence handling
  • Developing bespoke datasets and data loaders

Fine-Tuning Methodologies

  • Contrasting standard full fine-tuning with parameter-efficient approaches
  • Implementing LoRA and QLoRA for efficient model adaptation
  • Leveraging the Trainer API for rapid experimentation

Evaluating and Optimizing Models

  • Measuring specialized models using generation quality and accuracy indicators
  • Mitigating overfitting and managing generalization and validation sets
  • Best practices for performance tuning and logging

Deployment and Enterprise Usage

  • Storing and retrieving models for inference tasks
  • Releasing specialized models within secure corporate environments
  • Comparing on-premise versus cloud-based deployment tactics

Real-World Case Studies and Applications

  • Practical examples of enterprise adoption of LLaMA, Mistral, and Qwen
  • Managing multilingual and domain-specific adaptations
  • Discussion: Balancing trade-offs between open and closed models

Wrap-Up and Future Directions

Requirements

  • Familiarity with large language models (LLMs) and their underlying architecture
  • Proficiency in Python and PyTorch
  • Foundational knowledge of the Hugging Face ecosystem

Target Audience

  • Machine Learning Professionals
  • AI Developers

Custom Corporate Training

Training solutions designed exclusively for businesses.

  • Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
  • Flexible Schedule: Dates and times adapted to your team's agenda.
  • Format: Online (live), In-company (at your offices), or Hybrid.
Investment

Price per private group, online live training, starting from 2900 € + VAT*

Contact us for an exact quote and to hear our latest promotions

Upcoming Courses

Related Categories