Get in Touch
 Duration 21 hours

Course Outline

Module 1: Overview of Confluent Apache Kafka Architecture and Configuration

  • The role of Kafka in modern data pipelines
  • Key distinctions between Apache Kafka and Confluent Kafka
  • Essential components: producers, consumers, brokers, topics, and partitions
  • Deployment models and scaling strategies for Kafka clusters

Module 2: Configuring Zookeeper Quorums

  • Introduction to Zookeeper
  • The function of Zookeeper within a Kafka cluster
  • Determining optimal Zookeeper Quorum sizes
  • Zookeeper configuration parameters
  • Setting up SSH on servers
  • Practical exercise: Configuring Zookeeper as a team and as a service
  • Utilizing the Zookeeper Command Line Interface (CLI)
  • Practical exercise: Setting up Zookeeper Quorum configuration
  • The Zookeeper internal file system
  • Performance factors influencing Zookeeper
  • Demonstration of management tools for Zookeeper and Zoonavigator

Module 3: Configuring Kafka Clusters

  • Fundamental Kafka concepts
  • Core Kafka configuration settings
  • Practical exercise: Configuring Kafka brokers
  • Practical exercise: Running Kafka commands
  • Practical exercise: Setting up a Kafka Multi-Broker Cluster
  • Practical exercise: Testing Kafka cluster functionality
  • Verifying connectivity to the Kafka cluster
  • Configuring Advertised.listeners: a critical setting
  • Topic configuration details
  • Settings for downloading and ingesting topic messages
  • Practical exercise: Demonstrating Kafka resilience
  • Kafka performance: I/O operations
  • Kafka performance: Network (RED method)
  • Kafka performance: RAM usage
  • Kafka performance: CPU utilization
  • Kafka performance: Operating System (OS) considerations
  • Kafka performance: Additional factors
  • Practical exercise: Modifying Kafka broker configuration

Module 4: Advanced Kafka Configurations

  • Configuring the Landoop Kafka topic interface, Confluent REST Proxy, and Confluent Schema Registry
  • Message transmission and reception via CLI, Java, and the Spring framework
  • Monitoring metrics and tools (including Confluent Control Center and Elasticsearch)
  • Log file management and offset handling
  • High availability and disaster recovery principles
  • Achieving high availability through replication
  • Optimizing producer and consumer performance
  • Disaster recovery strategies
  • Failover control and data recovery procedures
  • Connector configuration
  • Implementing Kafka Connect
  • Integrating Kafka security features

Summary and Future Steps

Requirements

  • Proficiency with distributed systems and messaging concepts
  • Practical experience using the Linux command line
  • Fundamental knowledge of networking and system administration

Target Audience

  • System Administrators
  • DevOps Engineers
  • Platform and Infrastructure Teams

Custom Corporate Training

Training solutions designed exclusively for businesses.

  • Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
  • Flexible Schedule: Dates and times adapted to your team's agenda.
  • Format: Online (live), In-company (at your offices), or Hybrid.
Investment

Price per private group, online live training, starting from 4350 € + VAT*

Contact us for an exact quote and to hear our latest promotions

Testimonials (2)

Upcoming Courses

Related Categories