Choosing the Right Load Balancing Policy in Envoy Proxy
Learn how to choose between Round Robin, Least Request, and Maglev load balancing policies in Envoy Proxy to optimize for latency, cache hits, and resource distribution.
ReadMeFeed / Community knowledge
Real questions. Useful conversations. Find the people who know your stack.
Learn how to choose between Round Robin, Least Request, and Maglev load balancing policies in Envoy Proxy to optimize for latency, cache hits, and resource distribution.
Envoy's local and global rate limit filters solve different problems. Learn when to use an in-memory token bucket versus a distributed gRPC backend, with configuration examples and trade-offs.
Configure Envoy outlier detection to automatically eject unhealthy upstream hosts based on 5xx errors and latency, verify ejection via admin stats, and tune recovery options.
Learn how Envoy’s built‑in local rate‑limit filter protects downstream services from traffic spikes using a token‑bucket algorithm, with a concrete configuration example and verification steps.
Learn how to protect a backend service by applying Envoy’s built‑in Rate Limit Service filter to a specific route, with a concrete configuration example and operational considerations.
Learn how Npss’s Adaptive Flow Control throttles traffic to keep QoS, with a hands‑on config example, trade‑offs, and verification steps.
Cloudflare Rate Limiting allows operators to define request thresholds to mitigate abusive traffic. However, there is an inherent gap between the moment a request threshold is exceeded and the moment the configured action—such as a JS challenge or block—is applied across the edge network. This latency in metric aggregation and rule propagation can create a m
A technical guide on selecting the optimal Envoy load balancing policy, comparing Round Robin, Least Request, and Consistent Hashing to optimize backend performance.
When implementing a rate-limiting strategy in Envoy (v1.25+), the rate_limit filter communicates with an external gRPC service to determine if a request should be permitted. To facilitate integration testing without production credentials, a mock service can be used to simulate these decisions. A specific concern arises during high QPS scenarios when the rat