Serving
Rate limit
What is rate limit?
A rate limit caps how many requests a caller may make in a period. A well-behaved limit returns a specific status code and a header saying how long to wait, so a client can back off correctly rather than guess.
Read and write operations usually warrant different limits, since writes are more expensive and more dangerous to retry blindly.
A client that retries without honouring the wait interval makes the situation worse for everyone, including itself. Exponential backoff with jitter is the standard correct behaviour.
Related terms
Start with the free tier
A magic link creates your account, your tenant and your first API key. No card until you ask for compute.