Apache Kafka Connect

• Experience with Apache Kafka.
• Java programming experience.

Audience

• Developers

Kafka Connect is an API for moving large collections of data between Apache Kafka and other systems.

This instructor-led, live training (online or onsite) is aimed at developers who wish to integrate Apache Kafka with existing databases and applications for processing, analysis, etc.

By the end of this training, participants will be able to:

• Use Kafka Connect to ingest large amounts of data from a database into Kafka topics.
• Ingest log data generated by an application servers into Kafka topics.
• Make any collected data available for stream processing.
• Export data from Kafka topics into secondary systems for storage and analysis.

Format of the Course

• Interactive lecture and discussion.
• Lots of exercises and practice.
• Hands-on implementation in a live-lab environment.

Course Customization Options

• To request a customized training for this course, please contact us to arrange.

Introduction

Overview of the Apache Kafka Ecosystem (Zookeeper, Streams, Connect, etc.)

The Components of a Kafka Connect Cluster

Installing and Running Apache Kafka

Configuring the Connectors

Ingesting Database Data into Apache Kafka

Applying Transformations

Ingesting Data from a Web Server Log

Validating the Connection

Managing Connections with the REST API

Ingesting Real-time Data from the Web

Case Study: Reading and Transforming Data from Twitter

Processing and Analyzing Data with Kafka Streams

Deploying Kafka Connect

Writing Your Own Connector

Defining Dynamic Input/Output Streams

Monitoring and Managing Kafka Connect in Production

Troubleshooting

Summary and Conclusion