topic
LLM API and inference
How to serve and pay for language models: pricing, latency and the alternatives. all topics
LLM API and inference
How to serve and pay for language models: pricing, latency and the alternatives.
- Time to first token explained: how to measure TTFT and what it means for your usersWhat time to first token is, how it differs from TPOT and ITL, what drives it up, and how to measure it yourself with a Python script and p50 and p95 latency.9 November 2026, 7 min readread
- LLM hosting for business: managed API vs self-hosting vs on-prem, with real monthly costsWhat a managed LLM API, a rented GPU and an on-prem B200 server cost per month, with live prices, a break-even example and the costs no price list shows.9 November 2026, 8 min readread
- The cheapest LLM APIs in 2026: price per million tokens compared (OpenAI, Together, OpenRouter, GPU Flow)Price per million tokens on OpenAI, Together AI, OpenRouter and GPU Flow, each in its currency, with the cost of 1,000 requests and what makes a model cheap.9 November 2026, 9 min readread
- Free LLM API credits: six providers’ free tiers compared, and what our welcome credit buysThe free tiers of OpenAI, Gemini, Groq, Together AI, OpenRouter and Mistral, checked on their own pages, and what the GPU Flow welcome credit pays for.9 November 2026, 7 min readread
- vLLM vs Ollama vs a managed API: how to serve open-source models without owning a GPUvLLM, Ollama or a managed API? What each one is, what it costs and what you must operate, from their official docs, and how to self-host without buying a GPU.9 November 2026, 7 min readread