Apache Kafka for Developers

• Basic programming knowledge

Audience

• Developers
• Programmers

Apache Kafka is an open-source distributed event streaming platform that provides tools for building real-time streaming data pipelines and applications.

This instructor-led, live training (online or onsite) is aimed at intermediate-level developers who wish to develop big data applications with Apache Kafka.

By the end of this training, participants will be able to:

• Develop Kafka producers and consumers to send and read data from Kafka.
• Integrate Kafka with external systems using Kafka Connect.
• Write streaming applications with Kafka Streams & ksqlDB.
• Integrate a Kafka client application with Confluent Cloud for cloud-based Kafka deployments.
• Gain practical experience through hands-on exercises and real-world use cases.

Format of the Course

• Interactive lecture and discussion.
• Lots of exercises and practice.
• Hands-on implementation in a live-lab environment.

Course Customization Options

• To request a customized training for this course, please contact us to arrange.

Introduction

• Overview of Apache Kafka
• Introduction to event streaming and real-time data processing
• Overview of Apache Kafka and its features
• Use cases and benefits of Kafka in modern application development

Understanding Kafka Architecture and Core Concepts

• Kafka architecture: brokers, topics, partitions, and replicas
• Producers and consumers: publishing and consuming messages
• Understanding the role of ZooKeeper in Kafka

Kafka Topics and Partitions

• Topic creation and configuration
• Understanding partitions and their implications
• Replication and fault-tolerance in Kafka

Kafka Producers

• Creating Kafka producers using various programming languages
• Message serialization and serialization techniques
• Producer configurations and best practices

Kafka Consumers

• Developing Kafka consumers using different programming languages
• Configuring consumer groups and offsets
• Strategies for message processing and delivery guarantees

Integrating Kafka with External Systems using Kafka Connect

• Overview of Kafka Connect and its connectors
• Configuring and using Kafka Connect for data integration
• Integrating Kafka with external systems

Writing Streaming Applications with Kafka Streams & ksqlDB

• Introduction to Kafka Streams and its stream processing capabilities
• Developing stream processing applications with Kafka Streams
• Using ksqlDB for real-time data processing and analytics

Integrating a Kafka Client Application with Confluent Cloud

• Overview of Confluent Cloud and its features
• Configuring and connecting a Kafka client application with Confluent Cloud

Kafka Security

• Introduction to Kafka security features
• Configuring SSL/TLS for secure communication
• Authentication and authorization mechanisms in Kafka

Monitoring and Operations

• Monitoring Kafka using metrics and tools
• Managing Kafka clusters and resources
• Troubleshooting common issues and performance tuning

Best Practices and Real-world Use Cases

• Best practices for designing Kafka-based applications
• Case studies and examples of Kafka implementations in various industries
• Best practices for building scalable and fault-tolerant Kafka architectures

Summary and Next Steps