https://wimdy.works/tags/rate-limits/Recent content in Rate-Limits on Brian FaustHugoen-USMon, 01 Jan 0001 00:00:00 +0000https://wimdy.works/thoughts/a-rate-limit-belongs-to-all-the-workers-sharing-it/Sun, 01 Jul 2018 00:00:00 +0000https://wimdy.works/thoughts/a-rate-limit-belongs-to-all-the-workers-sharing-it/<p>One polling job receives a 429 response saying to try again in fifteen seconds, so it releases itself for fifteen seconds. During that pause, twenty other workers poll the same provider. They have not seen the response, and each sends another request into the closed window.</p> <p>The first job obeyed the limit. The application did not.</p> <h2 id="find-the-scope-before-choosing-the-delay">Find the scope before choosing the delay</h2> <p>A rate limit applies to some shared identity: an API credential, account, tenant, endpoint family, source address, or a combination of them. Every worker using that identity spends the same remote capacity.</p>