Managing State in Kafka: When to Use Log Compaction Over Retention
Learn how to use Apache Kafka Log Compaction to manage stateful data, handle deletions with tombstones, and avoid the pitfalls of infinite log growth.
Loading…
ReadMeFeed / Community knowledge
#distributed-systems
Real questions. Useful conversations. Find the people who know your stack.
apachekafkaSolving Message Loss in NATS with JetStream Persistence
Stop losing messages when subscribers go offline. Learn how to use NATS JetStream to implement durable persistence and at-least-once delivery guarantees.
natsChoosing Consistency Models for Distributed Social Graph Data
A guide to balancing strong and eventual consistency in distributed social graphs, comparing trade-offs for identity data versus social connections.
linkedinModeling Asynchronous Chaos: Using UML Sequence Diagrams for Distributed Systems
Stop guessing how distributed services interact. Learn how UML Sequence Diagrams model asynchronous messages, parallel processing, and timing constraints without diagram bloat.
Preventing API Drift with JSON Schema Validation
Stop relying on implicit API contracts. Learn how to use JSON Schema to enforce data integrity, handle polymorphism, and prevent breaking changes in distributed systems.
jsonApache Kafka Log Compaction: Stateful Streams with Compaction
Learn how to use Apache Kafka Log Compaction to transform topics into durable key-value stores for efficient application state recovery and management.
Architecting Durable Message Queues with NATS JetStream
Learn how to implement durable, 'at-least-once' messaging using NATS JetStream, focusing on File storage, Pull consumers, and operational lag monitoring.
Solving the 'Celebrity Problem': How Twitter Scaled Timeline Fan-out
Explore how Twitter transitioned from a Ruby monolith to a JVM-based microservices architecture to solve the 'celebrity problem' using a hybrid fan-out strategy.
scalaHow LeetCode Prevents Your Code from Crashing Their Servers
Explore the engineering behind LeetCode's judge system, from container isolation and cgroups to the challenges of multi-language resource calibration.
leetcode