Handling Gray Failures with Envoy Outlier Detection
Learn how to use Envoy's outlier detection to automatically eject flaky upstream hosts and prevent retry storms in microservice architectures.
ReadMeFeed / Community knowledge
Real questions. Useful conversations. Find the people who know your stack.
Learn how to use Envoy's outlier detection to automatically eject flaky upstream hosts and prevent retry storms in microservice architectures.
Intermittent 503s during traffic peaks with healthy upstreams usually mean Envoy's circuit breakers are tripping. Here's how to confirm which counter is overflowing and fix the right limit.
Learn how Envoy’s outlier detection automatically ejects unhealthy upstream hosts, how to configure it, what trade‑offs to watch, and how to verify the behavior in practice.
Configure Envoy's local token bucket rate limit filter with per-client keying, shadow-mode rollout, xDS updates, and verification via admin stats and access logs — plus the pitfalls that silently disable it.
Local rate limits silently scale with your replica count. Envoy's global rate limiting centralizes quota decisions in an external gRPC service — here's how the pieces fit, a working per-IP example, and the fail-open vs. fail-closed decision you can't skip.
Learn how Consul Connect injects Envoy sidecars to provide mTLS, intent‑based ACL, and zero‑downtime upgrades. Step‑by‑step example, trade‑offs, and real‑world checks.
Guide to identify token‑bucket starvation in Envoy’s local_rate_limit filter, adjust burst/refill values, and verify CPU and latency improvements.
Learn how Envoy’s passive outlier detection and connection‑pool circuit breakers work together to isolate failing upstream hosts and prevent overload, with a concrete configuration example and verification steps.
Envoy's xDS APIs enable dynamic config without restarts, but defaults don't scale automatically. Practical guidance on when ADS beats individual streams, the Delta xDS threshold, resource warming for zero-downtime rolls, and SDS trust boundaries.