DigitalOcean Load Balancer to Droplets: which boundary to scale when latency appears only under concurrent load
We run an HTTP service behind a DigitalOcean Load Balancer forwarding to a small pool of Droplets. Under low traffic, p99 latency is flat. When we ramp concurrent clients, tail latency climbs sharply, and we cannot tell whether the bottleneck is the load balancer tier or the backends. Our understanding of the documented behavior: the load balancer terminates