Streaming Audio: Apache Kafka® & Real-Time Data
Streaming Audio features all things Apache Kafka®, Confluent, real-time data, and the cloud. We cover frequently asked questions, best practices, and use cases from the Kafka community—from Kafka connectors and distributed systems, to data mesh, data integration, modern data architectures, and data mesh built with Confluent and cloud Kafka as a service. Join our hosts as they stream through a series of interviews, stories, and use cases with guests from the data streaming industry. Apache®️, Apache Kafka, Kafka, and the Kafka logo are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. No endorsement by The Apache Software Foundation is implied by the use of these marks.
Streaming Audio: Apache Kafka® & Real-Time Data
Kafka Screams: The Scariest JIRAs and How To Survive Them ft. Anna McDonald
In today's spooktacular episode of Streaming Audio, Anna McDonald (Technical Account Manager, Confluent) discusses six of the scariest Apache Kafka® JIRAs. Starting with KAFKA-6431: Lock Contention in Purgatory, Anna breaks down what purgatory is and how it’s not something to fear or avoid.
Next, she dives into KAFKA-8522: Tombstones Can Survive Forever, where she explains tombstones, compacted topics, null values, and log compaction. Not to mention there’s KAFKA-6880: Zombie Replicas Must Be Fenced, which sounds like the spookiest of them all.
KAFKA-8233, which focuses on the new TestTopology mummy (wrapper) class, provides one option for setting the topology through your Kafka Screams Streams application. As Anna puts it, "This opens doors for people to build better, more resilient, and more interesting topologies."
To close out the episode, Anna talks about two more JIRAs: KAFKA-6738, which focuses on the Kafka Connect dead letter queue as a means of handling bad data, and the terrifying KAFKA-5925 on the addition of an executioner API.
EPISODE LINKS
- KAFKA-6431: Lock Contention in Purgatory
- KAFKA-8522: Tombstones Can Survive Forever
- KAFKA-6880: Zombie Replicas Must Be Fenced
- KAFKA-8233: Helper Classes to Make it Simpler to Write Test Logic with TopologyTestDriver
- KAFKA-6738: Kafka Connect Handling of Bad Data
- KAFKA-5925: Adding Records Deletion Operation to the New Admin Client API
- Streaming Apps and Poison Pills: Handle the Unexpected with Kafka Streams
- Data Modeling for Apache Kafka – Streams, Topics & More with Dani Traphagen
- Distributed Systems Engineering with Apache Kafka ft. Jason Gustafson
- Kafka Streams Topology Visualizer
- Follow Anna McDonald on Twitter
- Follow Mitch Henderson on Twitter
- Join the Confluent Community Slack
- Fully managed Apache Kafka as a service! Try free.