Quickstart

Change two lines

Keep your prompt formats, streaming logic and tool calls. Only the base URL and the key change.

from openai import OpenAI

client = OpenAI(
    base_url="https://cheap-tokens.vercel.app/v1",
    api_key="ct_live_...",
)

response = client.chat.completions.create(
    model="llama-3.1-8b-instruct",
    messages=[{"role": "user", "content": "Summarize this in two sentences: ..."}],
)

Streaming

Set stream: true and read standard OpenAI SSE chunks. The final chunk carries usage.

curl -N https://cheap-tokens.vercel.app/v1/chat/completions \
  -H "Authorization: Bearer ct_live_..." \
  -H "Content-Type: application/json" \
  -d '{
    "model": "llama-3.1-8b-instruct",
    "stream": true,
    "messages": [{"role": "user", "content": "Summarize this in two sentences: ..."}]
  }'

A model list is available at GET https://cheap-tokens.vercel.app/v1/models with the same bearer key.

Region rules

• Each key is pinned to one region, us or eu, chosen when the key is created.
• A job only ever runs on a host inside the key's region.
• If no host in the region claims the job within 8 s, same-region backstop capacity serves it and the receipt says so.
• Sandbox keys get 25 lifetime test calls with at most 512 output tokens each, at no charge.

Error codes