back

LLM API and inference

9 min read4 providers

The cheapest LLM APIs in 2026: price per million tokens compared (OpenAI, Together, OpenRouter, GPU Flow)

The cheapest LLM API is the one that costs least for your traffic, and that depends on how many tokens you send compared with how many you get back. Here are the list prices of four providers, each in its own currency, and what 1,000 requests cost on each.

GPU Flow team. Published on 9 November 2026.

How is LLM API pricing calculated?

Almost every LLM API charges per million tokens, with two prices: one for input tokens (your instructions, the conversation so far and any documents you attach) and one for output tokens (what the model writes). Output is usually several times more expensive, because generating each token takes more GPU time than reading one.

Two more lines can move the bill. Cached input is a reduced price for the part of a prompt the provider has already seen, such as a long system prompt repeated on every request. And reasoning models usually bill their thinking as output tokens; Google, for one, writes it into its Gemini API price table. A model that thinks for 2,000 tokens before answering in 300 is billed for 2,300 output tokens.

What makes an LLM cheap for your workload?

To compare like for like, the tables below price two example requests. A support answer: about 500 input tokens and 300 output tokens. A retrieval (RAG) query over your documents: about 6,000 input tokens and 400 output tokens. Both are our assumptions, chosen to show how the order changes when input dominates.

Four things decide which model is cheapest for a given job.

Input vs output ratio

RAG, classification and document extraction are input-heavy: look at the input price first. Chat, writing and coding agents are output-heavy: the output price decides.

Active parameters

Mixture-of-experts models such as Gemma 4 26B A4B or Nemotron 3.5 Lightning only run a few billion parameters per token, which makes them cheap to serve for their size.

Numeric format

Quantised builds (FP8, NVFP4) need less memory and compute than the full-precision weights, which is one reason they can be offered at a lower price.

Caching and batching

A cached-input price rewards prompts that repeat the same prefix. Batch prices trade waiting time for a lower rate, if your job can wait.

How much does the OpenAI API cost per million tokens?

OpenAI publishes several service tiers. These are the standard prices, in US dollars, for its GPT-5 family; for gpt-5.5 and gpt-5.4 they are the rates for prompts under 272K tokens, which cost more above that size.

modelinput per 1M (US$)output per 1M (US$)1,000 support answers1,000 RAG queries
gpt-5-nano$0.05$0.40$0.145$0.46
gpt-5.4-nano$0.20$1.25$0.475$1.70
gpt-5-mini$0.25$2.00$0.725$2.30
gpt-5.4-mini$0.75$4.50$1.725$6.30
gpt-5$1.25$10.00$3.625$11.50
gpt-5.4$2.50$15.00$5.75$21.00
gpt-5.5$5.00$30.00$11.50$42.00

OpenAI standard-tier prices, in US dollars, checked on 9 November 2026. Source: developers.openai.com/api/docs/pricing

The nano and mini models are the ones to compare with small open models. The OpenAI models are proprietary: you cannot download them or run them on hardware of your own.

What does Together AI charge for open models?

Together AI serves open-weight models from several labs. A selection of its serverless chat prices, in US dollars per million tokens. Several of these models also have a lower cached-input price on the same page.

modelinput per 1M (US$)output per 1M (US$)1,000 support answers1,000 RAG queries
Qwen3.5 9B$0.17$0.25$0.16$1.12
gpt-oss-120B$0.15$0.60$0.255$1.14
NVIDIA Nemotron 3.5 Super VL$0.15$0.50$0.225$1.10
DeepSeek V4.1 Flash$0.30$1.20$0.51$2.28
GLM-5.3$1.40$4.40$2.02$10.16

Together AI serverless inference prices, in US dollars, checked on 9 November 2026. Source: www.together.ai/pricing

Together AI lists Gemma 4 and Qwen3.8 27B only in its fine-tuning table on that page, not among the serverless inference prices, so they are left out here.

What do models cost on OpenRouter?

OpenRouter is a router: one API in front of many providers, each with its own price for the same model. The figures below are the price OpenRouter lists for each model in its public model list, in US dollars per million tokens.

modelinput per 1M (US$)output per 1M (US$)1,000 support answers1,000 RAG queries
nvidia/nemotron-3.5-lightning$0.07$0.20$0.095$0.50
qwen/qwen3-14b$0.12$0.24$0.132$0.816
google/gemma-4-26b-a4b-it$0.09$0.30$0.135$0.66
qwen/qwen3.5-9b$0.17$0.25$0.16$1.12
openai/gpt-oss-120b$0.15$0.60$0.255$1.14
qwen/qwen3.8-27b$0.15$1.875$0.638$1.65
z-ai/glm-5.3$0.0699$1.40$0.455$0.979

OpenRouter model list and pricing page, in US dollars, checked on 9 November 2026. Sources: openrouter.ai/api/v1/models, openrouter.ai/pricing

Each model page also lists the price of every provider that serves it, some above and some below the figure here, and where a request lands depends on your routing settings. On the Standard plan OpenRouter adds a 5.5% platform fee, according to its pricing page, so the token price is not the whole bill.

What does GPU Flow charge per million tokens?

These are current Token Factory prices for every text and vision model in our catalogue, in euros with VAT included, read from the same source as our pricing page. The cached-input column is filled only where we bill a cache read.

modelinput per 1M (€)output per 1M (€)cached input (€)1,000 support answers1,000 RAG queries
Nemotron Nano 12B VL€0.06€0.24€0.102€0.456
Qwen3.8 27B€0.10€0.30€0.01€0.14€0.72
Qwen3.5 9B€0.10€0.15€0.01€0.095€0.66
Qwen3-VL 32B OCR€0.10€0.35€0.155€0.74
Gemma 4 26B A4B€0.12€0.30€0.012€0.15€0.84
Nemotron 3.5 Lightning 30B€0.12€0.30€0.15€0.84
Qwen3 14B€0.20€1.00€0.02€0.40€1.60
ALIA 40B Instruct€0.20€2.00€0.02€0.70€2.00
GLM 5.3 NVFP4€1.206€3.789€0.224€1.74€8.752

Same model, different providers: how do prices compare?

Several open models are on more than one of these platforms. The table puts them side by side, each price in its own currency, with the cost of 1,000 RAG queries for scale.

model and providerinput per 1Moutput per 1M1,000 RAG queries
Qwen3.5 9B, GPU Flow€0.10€0.15€0.66
Qwen3.5 9B, Together AI$0.17$0.25$1.12
qwen/qwen3.5-9b, OpenRouter$0.17$0.25$1.12
Qwen3 14B, GPU Flow€0.20€1.00€1.60
qwen/qwen3-14b, OpenRouter$0.12$0.24$0.816
Gemma 4 26B A4B, GPU Flow€0.12€0.30€0.84
google/gemma-4-26b-a4b-it, OpenRouter$0.09$0.30$0.66
Nemotron 3.5 Lightning 30B, GPU Flow€0.12€0.30€0.84
nvidia/nemotron-3.5-lightning, OpenRouter$0.07$0.20$0.50
Qwen3.8 27B, GPU Flow€0.10€0.30€0.72
qwen/qwen3.8-27b, OpenRouter$0.15$1.875$1.65
GLM 5.3 NVFP4, GPU Flow€1.206€3.789€8.752
GLM-5.3, Together AI$1.40$4.40$10.16
z-ai/glm-5.3, OpenRouter$0.0699$1.40$0.979

Two cautions before you pick a winner from this table. The same model name is not always the same build: we serve GLM 5.3 in its NVFP4 quantised version, for example, and on a router each provider chooses its own format. And a lower number in dollars is not automatically a lower bill in euros once you add the exchange rate, card fees and VAT. On some rows the dollar figure is lower than ours, on others it is higher; check the rows for the models you actually plan to use.

How this works on GPU Flow

Token Factory is billed in euros, with VAT included, so the price in the table is the price on your invoice, without currency conversion; customers in the Canary Islands, Ceuta, Melilla or outside the EU, and EU businesses with a valid VAT number, pay without VAT. There is one rate for everyone, with no volume tiers and no monthly fee.

You load credit and it goes down as you use it. When it runs out, the API answers with a 402 error until you top up; nothing is charged to your card automatically, so a bug in a loop cannot run up a bill beyond your balance. The API is OpenAI-compatible, so moving a workload over is a change of base URL, key and model name, and what you send is never used to train any model.

What else should you check besides the token price?

  1. 1Currency and tax: a dollar price is converted by your bank on each payment, and may or may not include VAT for your country.
  2. 2Platform and card fees: routers and some providers charge a percentage on top of the credit you buy.
  3. 3Minimum purchase: some providers require a first top-up before the first request, and that money is committed.
  4. 4Rate limits: the cheapest model is no use if your account can only send a handful of requests a minute.
  5. 5Reasoning length: a model with a low output price that thinks for thousands of tokens can cost more per answer than a pricier one that does not.

How to read these tables

Third-party prices are copied from each provider’s own page on the date shown, in their currency and without conversion; they change often, so check the source before you decide. Our prices are live. The support answer and RAG query sizes are assumptions, so run your own prompts through a token counter and use these tables as a starting point.

See every model with its price in euros

The pricing page lists every Token Factory model, text, vision and audio, with its live price per million tokens, minute, character or song, VAT included.