The Context Tax: Quadratic Cost Scaling and the $6M Healthcare RAG Overrun
May 7, 2026
The price sheet for a frontier language model lists a flat rate per million tokens. It does not list the compounding cost effect that emerges when those tokens are assembled into long-context requests. This distinction — between the unit price of a token and the system cost of a context window — is where the most dangerous budget surprises of 2026 are occurring. A healthcare organisation recently discovered this gap at the scale of a $6 million overrun in a production retrieval-augmented generation (RAG) pipeline. Understanding what happened requires reasoning about the physics of context before you can reason about the economics.
