How well can we measure open model inference share?
Reported by Interconnects1 source ↓
Interconnects published a paid research note on estimating open-model inference adoption, using startup disclosures and OpenRouter data. The author says available measures are imprecise; Fireworks reported serving more than 40 trillion tokens per day to customers’ customized models.
Key points
- Fireworks said it serves more than 40 trillion tokens per day to customers’ customized models
- Fireworks said that customized-model inference segment grew more than twofold since summer
- The note uses data from Baseten, Fireworks, Together AI and OpenRouter to estimate open-model inference
- Interconnects says its adoption measures are imprecise; the research notes are primarily for paid subscribers
Details
Interconnects presents the note as an estimate of the market for open-model inference and its share relative to closed-model providers. The author says the available evidence includes noisy platform metrics, startup marketing disclosures and imperfect public evaluations, so the estimates are uncertain.
The analysis focuses on inference providers Baseten, Fireworks and Together AI, as well as the open-model share of OpenRouter token volume. The author says hyperscalers such as Amazon Bedrock and Azure may also account for substantial usage, but their model-category breakdowns were not available to the author.
At its first company conference, Fireworks said it was serving more than 40 trillion tokens per day to customers’ customized models, a segment the company said had grown more than twofold since summer. The author expects Fireworks’ total daily volume to exceed 100 trillion tokens in a later update, but presents that as an estimate, not a reported figure.
The note also compares startup disclosures with Google token-volume figures from earnings reports. Interconnects says its dashboard remains free, while the research notes are primarily paid; the article does not provide a final estimate of open-model inference’s share of the overall market.
Written from coverage as of
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh