Pricing
Two ways to buy the same tokens: per-token with a hard p95, or a whole replica reserved. The numbers are being finalized and are not published yet.
- Worker-truth counts. The usage block on every response — streams included — carries token counts from the worker that did the work, not a client-side estimate.
- Aborts billed to the abort point. Disconnect mid-stream and you are billed for what was generated up to the abort, not for the full request.
- Cached tokens itemized.
prompt_tokens_details.cached_tokensappears on every response, so the cache discount is auditable per request.
| plan | input / 1M tokens | output / 1M tokens | cached input / 1M tokens |
|---|---|---|---|
| interactive per-token · hard p95, never preempted | — | — | — |
| dedicated a whole replica, reserved by the hour | — / hr per reserved replica, tokens not metered | ||
| cached input |
discounted and itemized per request in
prompt_tokens_details.cached_tokens | ||
What is already decided, independent of the numbers: interactive is per-token with an admission-controlled p95 and is never preempted; dedicated is a whole replica of the SKU with no neighbors of any kind and no per-token meter; cached input is discounted and itemized on every response. There is no perpetual free tier; new accounts get a small one-time evaluation credit.
OpenAI SDK compatible — change one line · evaluation credits included