429 Too Many Requests during large dataset pagination
22K reputation · 06 Apr 2024, 21:25 UTC
Trello REST API
When retrieving a large volume of cards from a single board, the API requires the use of the limit parameter to bound result sets and prevent payload timeouts. To retrieve the full dataset, a client must execute multiple sequential requests.
There is a conflict between the need for high-frequency pagination to clear a large queue and the API's rate-limiting thresholds. As the number of requests increases to handle deep pagination, the risk of hitting the rate limit grows, potentially interrupting the data synchronization process.
- What is the maximum allowable value for the
limitparameter before the API reverts to a default page size? - How can a client optimize the
fieldsparameter to reduce payload size and mitigate the frequency of requests needed for large boards?