Serving
Idempotency
What is idempotency?
An idempotent operation produces the same result whether performed once or repeated. For an API this is achieved with a caller-supplied key: a repeated request with the same key returns the original result rather than doing the work again.
It matters most where a retry would be expensive. Without it, a client that times out while starting a training job cannot safely retry, because the first request may have succeeded.
The key must be supplied by the caller, since only the caller knows whether this is a retry of an earlier intention or a genuinely new one.
Related terms
Start with the free tier
A magic link creates your account, your tenant and your first API key. No card until you ask for compute.