Course Outline
Getting Started with Azure Data Factory
- General overview of Azure Data Factory
- Essential concepts and architectural components
- Practical use cases and key advantages of ADF
Establishing Your ADF Environment
- Setting up and configuring an ADF instance
- Navigating the Azure Data Factory user interface
- Explaining integration runtimes
Managing Datasets and Linked Services
- Specifying datasets and linked services
- Establishing connections to diverse data sources
- Setting up authentication and secure connectivity
Building Data Pipelines
- Fundamentals of pipelines and their constituent parts
- Constructing basic pipelines using activities
- Designing a pipeline for data transfer
Data Flows and Transformation Activities
- Overview of data flows
- Exploring data transformation activities
- Designing and executing data flow transformations
Automating Pipelines with Scheduling and Triggers
- Configuring pipeline execution via triggers
- Utilizing tumbling window and event-driven triggers
- Tracking pipeline activity and interpreting output logs
Troubleshooting and Error Management
- Debugging pipelines and associated data flows
- Setting up error handling and retry protocols
- Incorporating error handling into existing pipelines
Enhancing Performance
- Recommended practices for optimizing data pipelines
- Managing and configuring parallelism and partitioning
- Tuning overall pipeline performance
Ensuring Security and Monitoring
- Protecting ADF through access control and permission settings
- Applying data encryption and secure transmission methods
- Overseeing data pipelines using native tools and alert systems
Complex Scenarios and System Integration
- Connecting ADF with additional Azure services
- Addressing intricate data integration challenges
- Developing a complete, end-to-end data integration solution
Recap and Future Directions
Requirements
- Foundational understanding of cloud computing principles
- Existing familiarity with data integration and ETL workflows
Target Audience
- Data engineers
- Data analysts
- ETL developers
- IT specialists
Custom Corporate Training
Training solutions designed exclusively for businesses.
- Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
- Flexible Schedule: Dates and times adapted to your team's agenda.
- Format: Online (live), In-company (at your offices), or Hybrid.
Price per private group, online live training, starting from 2900 € + VAT*
Contact us for an exact quote and to hear our latest promotions
Testimonials (2)
All of the training was great. Especially liked the training documentation to reference. Looking forward to the Advanced Training, when we are ready.
Amy Gregg - Qualfon
Course - Boomi Integration Fundamentals
I've find out new interesting things about Lambda and Serverless