Choosing Kafka Producer Acks: Balancing Latency and Durability
Learn how to pick the right Kafka producer acks level and configure min.insync.replicas so you can trade write latency against guaranteed durability.
Loading…
ReadMeFeed / Community knowledge
Apache Kafka
Real questions. Useful conversations. Find the people who know your stack.
Apache Kafka
Developer tools · #apachekafka
Achieving Exactly-Once Delivery in Apache Kafka with Idempotent Producers and Transactions
Enable Kafka exactly-once by turning on idempotent producers and using the transactional API. This guide shows the mechanism, a complete Java example, limits, and verification commands.
Add a Single Message Transform to a Kafka Connect Sink: Drop a Field and Rename Another
Learn how to drop a field and rename another in a Kafka Connect sink using a Single Message Transform. Step‑by‑step guide with config, deployment, validation, and recovery tips.
Enabling Exactly‑Once Semantics in Kafka Streams: Configuration, Code, and Pitfalls
Enable EOS in Kafka Streams with a single property switch, see a full Java example, and learn the limits, common mistakes, and how to verify that your application truly processes each record once.
Choosing the Right Kafka Consumer Rebalancing Strategy: Range, Round‑Robin, or Sticky
When scaling Kafka consumer groups, the rebalancing strategy can make or break throughput. This guide explains the constraints, compares the three supported strategies, and shows how to configure and validate your choice in a production‑ready cluster.
When Exactly-Once Works: Idempotent vs Transactional Producers in Kafka
Kafka's exactly-once semantics simplify cross-system consistency, but idempotent and transactional producers serve different scopes. This post compares their configuration, latency impact, and operational gotchas with practical verification tips.
Cutting Kafka Rebalance Disruption with CooperativeStickyAssignor
Rolling restarts don't have to pause every consumer. Here is how CooperativeStickyAssignor reduces partition reassignment disruption and what to verify before relying on it.
Kafka Log Compaction: How to Enable and Verify State‑Store Topics
Use Kafka’s log compaction to keep only the latest value per key in a topic. This guide walks through enabling the feature, testing it, and troubleshooting common pitfalls.
Designing a Kafka Topic with Log Compaction: Requirements, Minimal Setup, Boundaries, Checks, and Failure Modes
Learn how to size partitions, set compaction triggers, and monitor lag so that Kafka log compaction retains only the latest value per key without unexpected latency or storage spikes.