Course Outline
Fundamentals of Kafka Administration
- The position of Kafka in a modern data platform and typical production responsibilities.
- Core operational concepts: brokers, topics, partitions, offsets, and consumer groups.
- Replication principles: leaders and followers, in-sync replicas, and availability trade-offs.
- Key operational highlights and standard terminology used in runbooks.
KRaft Mode and Cluster Architecture
- KRaft fundamentals: controllers, metadata quorum, elections, and their operational significance.
- Deployment strategy: sizing for throughput, partitions, retention, and future growth.
- Node roles and layout: combined versus dedicated controllers, and fault domain considerations.
- Practical Lab: Inspecting KRaft metadata, validating quorum health, and interpreting controller logs.
Installation, Configuration, and Daily Operations
- Installation methods (packages, tarballs, containers) and standards for enterprise environments.
- Essential broker configurations affecting reliability: listeners, replication, log directories, and retention.
- Safe service management: startup sequences, graceful shutdown, and validation checks.
- Practical Lab: Deploying a multi-node cluster, verifying broker registration, and confirming baseline produce and consume operations.
Managing Topics, Partitions, and Data Distribution
- Topic lifecycle management via the Kafka CLI: creation, description, configuration updates, and deletion.
- Selecting appropriate partitions and replication factors for real-world workloads, including common pitfalls.
- Reassignment and balancing: determining when to move partitions and verifying progress safely.
- Practical Lab: Creating topics, triggering partition reassignment, simulating a broker outage, and confirming recovery.
Securing Kafka for Production Environments
- TLS for client and inter-broker traffic: certificates, trust chains, and verification steps.
- Authentication via SASL: choosing suitable mechanisms and avoiding configuration errors.
- Authorization through ACLs: least-privilege patterns for administrators, producers, and consumers.
- Practical Lab: Enabling TLS and SASL, validating client connectivity, and applying ACLs for application roles.
Observability, Reliability, and Troubleshooting
- Monitoring essentials: controller health, under-replicated partitions, request latency, and disk/network saturation.
- Logs and metrics: Interpreting broker logs and exposing metrics via JMX exporter to standard observability stacks.
- Operational playbooks: rolling restarts, safe configuration changes, and handling disk-full and ISR issues.
- Practical Lab: Constructing a minimal alert set, diagnosing a degraded cluster, and restoring healthy replication.
Upgrades and Disaster Recovery Preparedness
- Upgrade planning for Kafka: compatibility checks, staging strategies, and rollback procedures.
- Backup and recovery expectations: defining what can be backed up, what cannot, and basic configuration recovery.
- Cross-cluster replication overview and the application of MirrorMaker 2 for DR and migrations.
- Conclusion: Operational checklist, handover deliverables, and next steps for production rollout.
Requirements
- Proficiency in fundamental Linux administration (including users, services, files, and permissions).
- Familiarity with TCP/IP networking concepts (DNS, ports, firewalls, and load balancers).
- Basic scripting capabilities (Bash, PowerShell, or similar) for executing routine operational tasks.
Target Audience
- Kafka administrators and platform engineers accountable for the operation of Kafka clusters.
- Site reliability engineers and DevOps specialists supporting streaming platforms.
- Infrastructure and operations teams implementing new KRaft-based Kafka clusters or migrating from ZooKeeper.
Custom Corporate Training
Training solutions designed exclusively for businesses.
- Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
- Flexible Schedule: Dates and times adapted to your team's agenda.
- Format: Online (live), In-company (at your offices), or Hybrid.
Price per private group, online live training, starting from 4350 € + VAT*
Contact us for an exact quote and to hear our latest promotions
Testimonials (5)
Possibility to perform independent exercises in the training environment.
Tomasz - PKO Zycie Towarzystwo Ubezpieczen S.A.
Course - Kafka for Administrators
To the point, proper pace (bash basics required though)
Krzysztof - Agora SA
Course - Kafka for Administrators
Trainer accepts questions at any time of the session, even if the subject was taught few days past.
GOODLUCK MASHIMBA - Tanzania Revenue Authority
Course - Kafka for Administrators
Nice presentation skill
Md Maruf Hossain - ATOS PGS sp. z o.o.
Course - Kafka for Administrators
Grate skills, examples, very good exercises