Exponential Backoff vs Request Batching: Choosing the Right Strategy for Azure DevOps API Throttling
Goal Minimize latency spikes that appear only when Azure DevOps REST APIs or pipeline agents receive concurrent requests. Constraints & Uncertainty Azure DevOps imposes rate limits that trigger throttling, but documentation only recommends exponential backoff for retried requests. It provides no clear guidance on when to switch to request batching, a tec