Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 16 hours
Course Outline
Module 1: Overview of Confluent Apache Kafka Architecture and Cluster Setup
- Introduction to Apache Kafka and the Confluent Platform
- Core concepts: Kafka brokers, producers, consumers, and topics
- The function of Kafka in data streaming and messaging workflows
- Confluent extensions: REST Proxy, Schema Registry, and Control Center
- Cluster architecture breakdown: brokers, partitions, and replication
Module 2: Configuring the Zookeeper Quorum
- Introduction to Zookeeper
- The role of Zookeeper within a Kafka cluster
- Determining the optimal Zookeeper quorum size
- Reviewing Zookeeper configuration parameters
- Setting up SSH access on target servers
- Practical Lab: Configuring Zookeeper both as a team and as a service
- Utilizing the Zookeeper Command Line Interface (CLI)
- Practical Lab: Establishing a Zookeeper quorum
- Exploring Zookeeper’s internal file system
- Performance considerations specific to Zookeeper
- Demonstration: Overview of Zookeeper management tools and Zoonavigator
Module 3: Configuring the Kafka Cluster
- Foundational Kafka concepts
- Essential Kafka configuration settings
- Practical Lab: Configuring Kafka on a single broker
- Practical Lab: Executing core Kafka commands
- Practical Lab: Setting up a multi-broker Kafka cluster
- Practical Lab: Testing cluster functionality
- Verifying connectivity to the Kafka cluster
- Configuring advertised.listeners: a critical setting
- Managing topic configurations
- Setting up message ingestion and delivery mechanisms within topics
- Practical Lab: Demonstrating Kafka resilience capabilities
- Kafka performance analysis: I/O, network, RAM, CPU, and OS considerations
- Additional factors influencing Kafka performance
- Practical Lab: Modifying broker configurations effectively
Module 4: Advanced Kafka Configuration
- Configuration of Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry
- Message sending and receiving methods (CLI, Java, Spring Framework)
- Utilizing metrics and monitoring tools (e.g., Confluent Control Center, Elasticsearch)
- Managing log files and offsets
- Implementing high availability and disaster recovery protocols
- Achieving high availability through replication
- Performance tuning for producers and consumers
- Defining disaster recovery strategies
- Controlling failover and managing data recovery
- Setting up connectors
- Implementing Kafka Connect
- Implementing Kafka security features
Summary and Next Steps
Requirements
- Practical experience with Linux-based systems and command-line utilities
- Working knowledge of distributed systems principles
- Foundational understanding of networking and system configuration
Target Audience
- DevOps and SRE teams responsible for managing Kafka deployments
- System administrators working with Confluent and Zookeeper
- Kafka developers and architects tasked with building scalable systems
Testimonials (2)
Possibility to perform independent exercises in the training environment.
Tomasz - PKO Zycie Towarzystwo Ubezpieczen S.A.
Course - Kafka for Administrators
Very practical examples. The trainer has tried to keep a pace where everybody is able to go with even though the group was quite inhomogeneous regarding the knowhow. He has provided a lot of support to basically everybody who asked for it :)