Apache Kafka’s rise in popularity as a streaming platform has demanded a revisit of its traditional at least once message delivery semantics. In this talk, we present the recent additions to Apache Kafka to achieve exactly once semantics. We shall discuss the newly introduced transactional APIs and use Kafka Streams as an example to show how these APIs are leveraged for streams tasks.
12. 12Confidential
Why improve?
• Stream processing is becoming a bigger part of the data landscape.
• Apache Kafka is the foundation for such stream processing.
• Strengthening Kafka’ssemantics expands the universe of
streaming applications.
32. 32Confidential
Putting it together
• We understood Kafka’sexisting delivery semantics.
• Learned how these have been strengthened.
• Learned how the new semantics work.
• Saw, it’s easy to use with higher levelAPIs like Kafka Streams or
Apache Spark.