Get in Touch
 Duration 21 hours

Course Outline

Introduction to Apache Airflow in the Context of Machine Learning

  • An overview of Apache Airflow and its significance within data science.
  • Key features that enable the automation of machine learning workflows.
  • Initial setup of Airflow for data science initiatives.

Constructing Machine Learning Pipelines with Airflow

  • Designing DAGs to support end-to-end ML workflows.
  • Utilizing operators for data ingestion, preprocessing, and feature engineering.
  • Scheduling tasks and managing dependencies within the pipeline.

Training and Validating Models

  • Automating model training processes using Airflow.
  • Connecting Airflow with ML frameworks such as TensorFlow and PyTorch.
  • Validating models and capturing evaluation metrics.

Deploying and Monitoring Models

  • Releasing machine learning models through automated pipelines.
  • Tracking deployed models via Airflow tasks.
  • Managing retraining cycles and model updates.

Advanced Customization and System Integration

  • Creating custom operators for ML-specific requirements.
  • Linking Airflow with cloud platforms and specialized ML services.
  • Enhancing Airflow workflows through plugins and sensors.

Optimizing and Scaling ML Pipelines

  • Enhancing workflow performance for handling large-scale datasets.
  • Scaling Airflow infrastructure using Celery and Kubernetes.
  • Adopting best practices for production-grade ML workflows.

Case Studies and Real-World Applications

  • Practical examples of ML automation leveraging Airflow.
  • Practical exercise: Constructing a complete end-to-end ML pipeline.
  • Exploring challenges and effective solutions in ML workflow management.

Conclusion and Future Directions

Requirements

  • A solid grasp of machine learning workflows and fundamental concepts.
  • Foundational knowledge of Apache Airflow, encompassing DAGs and operators.
  • Strong proficiency in Python programming.

Target Audience

  • Data scientists.
  • Machine learning engineers.
  • AI developers.

Custom Corporate Training

Training solutions designed exclusively for businesses.

  • Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
  • Flexible Schedule: Dates and times adapted to your team's agenda.
  • Format: Online (live), In-company (at your offices), or Hybrid.
Investment

Price per private group, online live training, starting from 4350 € + VAT*

Contact us for an exact quote and to hear our latest promotions

Testimonials (2)

Upcoming Courses

Related Categories