Concurrent request latency limits for a single Cloud Storage object
0 reputation · 13 Sept 2023, 00:01 UTC
Hot object behavior under concurrent Cloud Storage requests
Google Cloud Storage is built for high aggregate request rates, and its documentation warns that concentrating many concurrent requests on a single object name can increase latency. The guidance recommends distributing load across many objects rather than publishing a hard per-object requests-per-second ceiling, leaving operators without a clear numeric cutoff for when a single object is too hot.
Because the latency effect appears only under concurrency, single-client testing can look healthy while production traffic to the same object degrades. The unresolved decision is whether a given workload—characterized by object size, client concurrency, retry behavior, and region—has crossed an undocumented threshold that warrants redesigning object naming, adding a cache layer, or moving the hot item to a different service.
What operational signal should determine that a single Cloud Storage object is too hot, given that Google does not publish a universal per-object request-rate limit? How should teams compare single-client and multi-client latency percentiles to distinguish normal variance from hot-object contention? At what point does the absence of a documented quota make measured p99 latency and retryable error rates the only reliable basis for an architectural change?