LLM API and inference
9 min read4 providersThe cheapest LLM APIs in 2026: price per million tokens compared (OpenAI, Together, OpenRouter, GPU Flow)
The cheapest LLM API is the one that costs least for your traffic, and that depends on how many tokens you send compared with how many you get back. Here are the list prices of four providers, each in its own currency, and what 1,000 requests cost on each.
GPU Flow team. Published on 9 November 2026.
How is LLM API pricing calculated?
Almost every LLM API charges per million tokens, with two prices: one for input tokens (your instructions, the conversation so far and any documents you attach) and one for output tokens (what the model writes). Output is usually several times more expensive, because generating each token takes more GPU time than reading one.
Two more lines can move the bill. Cached input is a reduced price for the part of a prompt the provider has already seen, such as a long system prompt repeated on every request. And reasoning models usually bill their thinking as output tokens; Google, for one, writes it into its Gemini API price table. A model that thinks for 2,000 tokens before answering in 300 is billed for 2,300 output tokens.
What makes an LLM cheap for your workload?
To compare like for like, the tables below price two example requests. A support answer: about 500 input tokens and 300 output tokens. A retrieval (RAG) query over your documents: about 6,000 input tokens and 400 output tokens. Both are our assumptions, chosen to show how the order changes when input dominates.
Four things decide which model is cheapest for a given job.
Input vs output ratio
RAG, classification and document extraction are input-heavy: look at the input price first. Chat, writing and coding agents are output-heavy: the output price decides.
Active parameters
Mixture-of-experts models such as Gemma 4 26B A4B or Nemotron 3.5 Lightning only run a few billion parameters per token, which makes them cheap to serve for their size.
Numeric format
Quantised builds (FP8, NVFP4) need less memory and compute than the full-precision weights, which is one reason they can be offered at a lower price.
Caching and batching
A cached-input price rewards prompts that repeat the same prefix. Batch prices trade waiting time for a lower rate, if your job can wait.
How much does the OpenAI API cost per million tokens?
OpenAI publishes several service tiers. These are the standard prices, in US dollars, for its GPT-5 family; for gpt-5.5 and gpt-5.4 they are the rates for prompts under 272K tokens, which cost more above that size.
| model | input per 1M (US$) | output per 1M (US$) | 1,000 support answers | 1,000 RAG queries |
|---|---|---|---|---|
| gpt-5-nano | $0.05 | $0.40 | $0.145 | $0.46 |
| gpt-5.4-nano | $0.20 | $1.25 | $0.475 | $1.70 |
| gpt-5-mini | $0.25 | $2.00 | $0.725 | $2.30 |
| gpt-5.4-mini | $0.75 | $4.50 | $1.725 | $6.30 |
| gpt-5 | $1.25 | $10.00 | $3.625 | $11.50 |
| gpt-5.4 | $2.50 | $15.00 | $5.75 | $21.00 |
| gpt-5.5 | $5.00 | $30.00 | $11.50 | $42.00 |
OpenAI standard-tier prices, in US dollars, checked on 9 November 2026. Source: developers.openai.com/api/docs/pricing
The nano and mini models are the ones to compare with small open models. The OpenAI models are proprietary: you cannot download them or run them on hardware of your own.
What does Together AI charge for open models?
Together AI serves open-weight models from several labs. A selection of its serverless chat prices, in US dollars per million tokens. Several of these models also have a lower cached-input price on the same page.
| model | input per 1M (US$) | output per 1M (US$) | 1,000 support answers | 1,000 RAG queries |
|---|---|---|---|---|
| Qwen3.5 9B | $0.17 | $0.25 | $0.16 | $1.12 |
| gpt-oss-120B | $0.15 | $0.60 | $0.255 | $1.14 |
| NVIDIA Nemotron 3.5 Super VL | $0.15 | $0.50 | $0.225 | $1.10 |
| DeepSeek V4.1 Flash | $0.30 | $1.20 | $0.51 | $2.28 |
| GLM-5.3 | $1.40 | $4.40 | $2.02 | $10.16 |
Together AI serverless inference prices, in US dollars, checked on 9 November 2026. Source: www.together.ai/pricing
Together AI lists Gemma 4 and Qwen3.8 27B only in its fine-tuning table on that page, not among the serverless inference prices, so they are left out here.
What do models cost on OpenRouter?
OpenRouter is a router: one API in front of many providers, each with its own price for the same model. The figures below are the price OpenRouter lists for each model in its public model list, in US dollars per million tokens.
| model | input per 1M (US$) | output per 1M (US$) | 1,000 support answers | 1,000 RAG queries |
|---|---|---|---|---|
| nvidia/nemotron-3.5-lightning | $0.07 | $0.20 | $0.095 | $0.50 |
| qwen/qwen3-14b | $0.12 | $0.24 | $0.132 | $0.816 |
| google/gemma-4-26b-a4b-it | $0.09 | $0.30 | $0.135 | $0.66 |
| qwen/qwen3.5-9b | $0.17 | $0.25 | $0.16 | $1.12 |
| openai/gpt-oss-120b | $0.15 | $0.60 | $0.255 | $1.14 |
| qwen/qwen3.8-27b | $0.15 | $1.875 | $0.638 | $1.65 |
| z-ai/glm-5.3 | $0.0699 | $1.40 | $0.455 | $0.979 |
OpenRouter model list and pricing page, in US dollars, checked on 9 November 2026. Sources: openrouter.ai/api/v1/models, openrouter.ai/pricing
Each model page also lists the price of every provider that serves it, some above and some below the figure here, and where a request lands depends on your routing settings. On the Standard plan OpenRouter adds a 5.5% platform fee, according to its pricing page, so the token price is not the whole bill.
What does GPU Flow charge per million tokens?
These are current Token Factory prices for every text and vision model in our catalogue, in euros with VAT included, read from the same source as our pricing page. The cached-input column is filled only where we bill a cache read.
| model | input per 1M (€) | output per 1M (€) | cached input (€) | 1,000 support answers | 1,000 RAG queries |
|---|---|---|---|---|---|
| Nemotron Nano 12B VL | €0.06 | €0.24 | €0.102 | €0.456 | |
| Qwen3.8 27B | €0.10 | €0.30 | €0.01 | €0.14 | €0.72 |
| Qwen3.5 9B | €0.10 | €0.15 | €0.01 | €0.095 | €0.66 |
| Qwen3-VL 32B OCR | €0.10 | €0.35 | €0.155 | €0.74 | |
| Gemma 4 26B A4B | €0.12 | €0.30 | €0.012 | €0.15 | €0.84 |
| Nemotron 3.5 Lightning 30B | €0.12 | €0.30 | €0.15 | €0.84 | |
| Qwen3 14B | €0.20 | €1.00 | €0.02 | €0.40 | €1.60 |
| ALIA 40B Instruct | €0.20 | €2.00 | €0.02 | €0.70 | €2.00 |
| GLM 5.3 NVFP4 | €1.206 | €3.789 | €0.224 | €1.74 | €8.752 |
Same model, different providers: how do prices compare?
Several open models are on more than one of these platforms. The table puts them side by side, each price in its own currency, with the cost of 1,000 RAG queries for scale.
| model and provider | input per 1M | output per 1M | 1,000 RAG queries |
|---|---|---|---|
| Qwen3.5 9B, GPU Flow | €0.10 | €0.15 | €0.66 |
| Qwen3.5 9B, Together AI | $0.17 | $0.25 | $1.12 |
| qwen/qwen3.5-9b, OpenRouter | $0.17 | $0.25 | $1.12 |
| Qwen3 14B, GPU Flow | €0.20 | €1.00 | €1.60 |
| qwen/qwen3-14b, OpenRouter | $0.12 | $0.24 | $0.816 |
| Gemma 4 26B A4B, GPU Flow | €0.12 | €0.30 | €0.84 |
| google/gemma-4-26b-a4b-it, OpenRouter | $0.09 | $0.30 | $0.66 |
| Nemotron 3.5 Lightning 30B, GPU Flow | €0.12 | €0.30 | €0.84 |
| nvidia/nemotron-3.5-lightning, OpenRouter | $0.07 | $0.20 | $0.50 |
| Qwen3.8 27B, GPU Flow | €0.10 | €0.30 | €0.72 |
| qwen/qwen3.8-27b, OpenRouter | $0.15 | $1.875 | $1.65 |
| GLM 5.3 NVFP4, GPU Flow | €1.206 | €3.789 | €8.752 |
| GLM-5.3, Together AI | $1.40 | $4.40 | $10.16 |
| z-ai/glm-5.3, OpenRouter | $0.0699 | $1.40 | $0.979 |
Two cautions before you pick a winner from this table. The same model name is not always the same build: we serve GLM 5.3 in its NVFP4 quantised version, for example, and on a router each provider chooses its own format. And a lower number in dollars is not automatically a lower bill in euros once you add the exchange rate, card fees and VAT. On some rows the dollar figure is lower than ours, on others it is higher; check the rows for the models you actually plan to use.
How this works on GPU Flow
Token Factory is billed in euros, with VAT included, so the price in the table is the price on your invoice, without currency conversion; customers in the Canary Islands, Ceuta, Melilla or outside the EU, and EU businesses with a valid VAT number, pay without VAT. There is one rate for everyone, with no volume tiers and no monthly fee.
You load credit and it goes down as you use it. When it runs out, the API answers with a 402 error until you top up; nothing is charged to your card automatically, so a bug in a loop cannot run up a bill beyond your balance. The API is OpenAI-compatible, so moving a workload over is a change of base URL, key and model name, and what you send is never used to train any model.
What else should you check besides the token price?
- 1Currency and tax: a dollar price is converted by your bank on each payment, and may or may not include VAT for your country.
- 2Platform and card fees: routers and some providers charge a percentage on top of the credit you buy.
- 3Minimum purchase: some providers require a first top-up before the first request, and that money is committed.
- 4Rate limits: the cheapest model is no use if your account can only send a handful of requests a minute.
- 5Reasoning length: a model with a low output price that thinks for thousands of tokens can cost more per answer than a pricier one that does not.
How to read these tables
Third-party prices are copied from each provider’s own page on the date shown, in their currency and without conversion; they change often, so check the source before you decide. Our prices are live. The support answer and RAG query sizes are assumptions, so run your own prompts through a token counter and use these tables as a starting point.
See every model with its price in euros
The pricing page lists every Token Factory model, text, vision and audio, with its live price per million tokens, minute, character or song, VAT included.
Related
- Free LLM API credits: six providers’ free tiers compared, and what our welcome credit buysThe free tiers of OpenAI, Gemini, Groq, Together AI, OpenRouter and Mistral, checked on their own pages, and what the GPU Flow welcome credit pays for.
- An OpenAI API alternative: GPU Flow vs OpenAIPrice per million tokens, audio, migration and when to stay on OpenAI, with their prices checked on their own site.