Course Outline
Introduction to Apache Airflow in the Context of Machine Learning
- An overview of Apache Airflow and its significance within data science.
- Key features that enable the automation of machine learning workflows.
- Initial setup of Airflow for data science initiatives.
Constructing Machine Learning Pipelines with Airflow
- Designing DAGs to support end-to-end ML workflows.
- Utilizing operators for data ingestion, preprocessing, and feature engineering.
- Scheduling tasks and managing dependencies within the pipeline.
Training and Validating Models
- Automating model training processes using Airflow.
- Connecting Airflow with ML frameworks such as TensorFlow and PyTorch.
- Validating models and capturing evaluation metrics.
Deploying and Monitoring Models
- Releasing machine learning models through automated pipelines.
- Tracking deployed models via Airflow tasks.
- Managing retraining cycles and model updates.
Advanced Customization and System Integration
- Creating custom operators for ML-specific requirements.
- Linking Airflow with cloud platforms and specialized ML services.
- Enhancing Airflow workflows through plugins and sensors.
Optimizing and Scaling ML Pipelines
- Enhancing workflow performance for handling large-scale datasets.
- Scaling Airflow infrastructure using Celery and Kubernetes.
- Adopting best practices for production-grade ML workflows.
Case Studies and Real-World Applications
- Practical examples of ML automation leveraging Airflow.
- Practical exercise: Constructing a complete end-to-end ML pipeline.
- Exploring challenges and effective solutions in ML workflow management.
Conclusion and Future Directions
Requirements
- A solid grasp of machine learning workflows and fundamental concepts.
- Foundational knowledge of Apache Airflow, encompassing DAGs and operators.
- Strong proficiency in Python programming.
Target Audience
- Data scientists.
- Machine learning engineers.
- AI developers.
Custom Corporate Training
Training solutions designed exclusively for businesses.
- Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
- Flexible Schedule: Dates and times adapted to your team's agenda.
- Format: Online (live), In-company (at your offices), or Hybrid.
Price per private group, online live training, starting from 4350 € + VAT*
Contact us for an exact quote and to hear our latest promotions
Testimonials (2)
Getting people that never used AI some repetition in prompting and people that do use AI to consider different methods to using it.
Matthew Gay - Tarsus Pharmaceuticals
Course - Artificial Intelligence (AI) Overview
Working from first principles in a focused way, and moving to applying case studies within the same day