ReadMeFeed / Community knowledge
Real questions. Useful conversations. Find the people who know your stack.
Enable and tune Kafka log compaction so stream-processing state rebuilds stay fast: topic configuration, dirty-ratio tuning, tombstone deletes, and verification with console producers and consumers.
Enable Kafka log compaction with cleanup.policy=compact, write keyed records and tombstones correctly, tune the dirty ratio and segment roll, and verify the cleaner kept only the latest value per key.
When you need to replay only the most recent value for each key in a Kafka topic, log compaction is the right tool. This guide explains how compaction works, shows a practical example, and discusses trade‑offs and limits so you can decide if it fits your use case.
Learn how to use Apache Kafka Log Compaction to manage stateful data, handle deletions with tombstones, and avoid the pitfalls of infinite log growth.
Learn how Apache Kafka Log Compaction manages stateful data by retaining the latest value for each key, reducing storage overhead, and implementing tombstones for deletions.
Learn how to use Apache Kafka Log Compaction to transform topics into durable key-value stores for efficient application state recovery and management.
apachekafka