Course : Apache Kafka, centralizing data flows in real time

A unified message agent system

Practical course - 3d - 21h00 - Ref. AKU
Price : 2220 € E.T.

Apache Kafka, centralizing data flows in real time

A unified message agent system


Required course

This training course will enable you to master the message agents of the Apache Foundation's Kafka open source project for handling low-latency, real-time data streams. You'll learn how to use ksqlDB, how to set up data security and Kafka's management tools.


INTER
IN-HOUSE
CUSTOM

Practical course in person or remote class
Disponible en anglais, à la demande

Ref. AKU
  3d - 21h00
2220 € E.T.




This training course will enable you to master the message agents of the Apache Foundation's Kafka open source project for handling low-latency, real-time data streams. You'll learn how to use ksqlDB, how to set up data security and Kafka's management tools.


Teaching objectives
At the end of the training, the participant will be able to:
Understand the principles of inter-application communications
Understanding Kafka's architecture
Implementing ksqlDB
Working safely with Kafka

Intended audience
Architects, project managers, developers, DevOps teams.

Prerequisites
Notions of enterprise application architectures, knowledge of network protocols, good knowledge of Java or other languages. Knowledge of Spring or Node.js is a plus.

Practical details
Hands-on work
Development of a red wire project linking several applications via Kafka.

Course schedule

1
The evolution of Kafka's IT systems and areas of use

  • Enterprise application architectures: cloud, microservices, big data, elastic architectures, SOA.
  • Communication between applications.
  • Kafka's usefulness.
  • Message brokers: producers, consumers, brokers.
  • Comparisons between different brokers and Kafka.

2
Overview of Kafka

  • Clusters.
  • Brokers.
  • Topics.
  • Sheet music.
  • Offsets.
  • Introducing ZooKeeper and its new alternative KRaft.
Hands-on work
Install and configure kafka.

3
High-availability architecture

  • Data replication and security: message consistency, broker failure management, log management.
  • Broker cluster: set-up and configuration, monitoring, log management.
  • Zookeeper cluster.
  • Kafka Connect.
  • Group and load management.

4
ksqlDB overview and ecosystem

  • ksqlDB use cases: why ksqlDB, use case examples, ksqlDB and licensing.
  • ksqlDB & Kafka.
  • Interactive use of ksqlDB.
  • ksqlDB architecture.
  • ksqlDB CLI.
  • ksqlDB server modes.

5
Using ksqlDB

  • Streams and Tables.
  • Kafka message and data formats.
  • Data manipulation and aggregation.
  • User-defined functions (UDF).
  • Data enrichment and joins.
  • Windowed operation.
  • Metrics and observability.
Hands-on work
Use ksqlDB (data manipulation and aggregation).

6
Kafka Streams

  • Anatomy of a Streams application.
  • Setting up a Streams application.
  • Topology of a Streams application.
  • Stateless and Stateful operations.
  • Kafka Streams DSL.
  • Sliding window operations.
  • Processor API.

7
Safety with Kafka

  • SSL encryption.
  • Configuration with SASL.
  • Using LCDs.
  • Security.
Hands-on work
Safety implementation.

8
Kafka tools

  • Kafka management tools.
  • Monitoring Kafka.
  • Apache Avro.
  • The "Schema Registry".
  • Presentation of the Confluent platform: Differences with OpenSource.
Hands-on work
Monitor, monitor Kafka.


Customer reviews
4,4 / 5
Customer reviews are based on end-of-course evaluations. The score is calculated from all evaluations within the past year. Only reviews with a textual comment are displayed.
FLORIAN V.
16/09/26
4 / 5

The training was a bit too much like a lecture for my personal taste, but at least the trainer was clear and a pleasure to listen to, as well as being passionate about the subject.
YOHANN S.
16/09/26
5 / 5

The trainer has a thorough grasp of the subject and is both mature and pleasant.
NIZAR H.
16/09/26
5 / 5

Solid, well-structured content; nothing essential is missing. The trainer clearly has a thorough grasp of the subject. Their practical examples and diagrams drawn on the spot are effective. A good training course



Publication date : 02/21/2024



This programme is an original creation, developed by the teaching teams at ORSYS Formation. Any reproduction, representation, adaptation or use, in whole or in part, without the prior written authorisation of ORSYS, is strictly prohibited. ORSYS reserves the right to take any action necessary to protect its intellectual property rights.


This programme is an original creation, developed by the teaching teams at ORSYS Formation. Any reproduction, representation, adaptation or use, in whole or in part, without the prior written authorisation of ORSYS, is strictly prohibited. ORSYS reserves the right to take any action necessary to protect its intellectual property rights.