Token prices fall as access tiers rise

What's happening — and why

How it works

Evidence over time

24 supporting · 0 counter — hover or tap a point for detail, click to jump to the row.

Evidence

Trivia

• DeepSeek V2's May 2024 launch at $0.14 per million input tokens reset the entire industry's price-floor expectations for coding-capable models — within 18 months every major frontier vendor had cut per-token prices at least once. No prior software category has experienced a 10-100× cost compression within two years of reaching mainstream adoption, making token deflation structurally unlike any historical software pricing precedent.

• Anthropic's August 2024 prompt-caching launch produced the largest single-day effective price reduction in the corpus (up to 80% off cached input) without any model change — demonstrating that token deflation arrives through infrastructure optimisation (caching, batching) as well as through model-generation cuts, and that the two mechanisms compound. A buyer using both batch (50% off) and caching (up to 80% off cached portions) can reduce effective input cost by 90%+ on workloads with stable system prompts.

• The scissors dynamic — token API prices falling while consumer subscription ceilings rise — is the defining pricing paradox of the 2024-2026 AI market. You.com's 6.7× consumer repricing (from $30 Team to $200 Max) and Character.ai's ad insertion for free users both happened while the underlying token rates kept deflating. The divergence shows that AI products have successfully decoupled human-facing access pricing from the compute costs beneath them.

• Anthropic's June 2026 Fable 5 / Mythos 5 launch is the corpus's clearest proof that token deflation is per-tier, not per-vendor: the company opened a new $10/$50 flagship band — exactly double Opus 4.8's $5/$25 — without cutting or raising any existing tier. Three weeks earlier (2026-05-30) it had rebased Opus itself ~3× downward from the legacy $15/$75. So inside one product line and one month, the established tiers deflated while the 'best-available' ceiling re-inflated 2×, confirming that what falls is the price of a fixed capability level, not the price of the frontier.

• Together AI cut its on-demand H100 rate twice inside a single week ending 2026-06-30 ($4.79 → $3.99/hr), and its $3.09/hr reserved floor now sits BELOW Lambda Labs' $3.99 on-demand rate logged just three weeks earlier — the first time in the corpus that a managed-cluster vendor's reserved price has undercut a peer's on-demand price, evidence that the 'GPU scarcity inflates access' counter-current is breaking down under managed-cluster competition.

• The $3/$15 Claude Sonnet band was the single most durable price constant in the corpus — held flat across four model generations from Claude 3 through Sonnet 4.6 while capability climbed. On 2026-07-06 Sonnet 5 finally bent it, launching at an introductory $2/$10 through Aug 31 before reverting to $3/$15. The anchor didn't break permanently — it dipped — but even a temporary intro cut on the corpus's most stable price is the clearest sign that generational deflation now reaches the tiers vendors most want to keep stable.

• The same 2026-07-06 batch that pushed Sonnet's anchor down also produced the corpus's first frontier-lab token *increase*: Mistral raised Small 4 by 50% on input and 100% on output. Two frontier labs moved their token prices in opposite directions on the same date — the cleanest proof that token deflation is a dominant trend, not a law: a specific under-priced SKU can still be repriced up mid-life.

• DeepInfra broke its own brand on 2026-07-14: the vendor whose reputation in cost-sensitive communities was built on relentless public price CUTS raised dedicated GPU-hour rates 16-32% across the board (H100 +23%, B200 +32%) and lifted its popular DeepSeek-V3.1 tokens from $0.21/$0.79 to $0.25/$0.95 — the corpus's first case of a commodity-inference vendor raising its WHOLE card rather than one under-priced SKU, evidence that even the deflation poster child can be forced up when Blackwell-generation supply and demand tighten.

• xAI priced a new flagship ABOVE its predecessor for the first time on 2026-07-14: grok-4.5 launched at $2/$6 per 1M versus the still-live grok-4.3 at $1.25/$2.50 — reversing xAI's multi-year per-token markdown and keeping the cheaper model live so the premium is reserved for the higher-intelligence tier. Combined with Google's AlphaEvolve 3×-all-in agent surcharge the same day, the frontier ceiling re-inflated via BOTH a higher flagship and an agent multiplier while Together (−15%/−25%) and RunPod kept cutting GPU beneath them.

For buyers

Re-baseline token-cost assumptions at least twice a year — a model you priced six months ago is usually cheaper now, and a newer model may be cheaper and better. Don't extrapolate the deflation to seats: model the workload as raw metered tokens (falling) separately from per-seat access (rising), and pick the cheaper envelope deliberately.

For vendors

To ride deflation you need per-model rate cards that can change without breaking contracts, plus structural discounts (caching, batch) to cut effective price without touching headline rates. To monetise access, a premium seat tier with priority or uncapped usage captures the value that falling tokens leave on the table.

Outlook — what to watch

Expect another leg down: open-weight models (DeepSeek, Llama-class) keep resetting the floor, and caching/batch discounts are spreading. The deflation only stalls if frontier capability stops commoditising — watch whether any vendor can hold a premium token price on a genuinely differentiated model. Access tiers still have room to climb.

FAQ

Related trends

• The $200 prosumer ceiling
• Batch and cache discounts as a standard playbook
• Credits as the universal currency