Sources and Methodology

This page explains where the numbers on the Models and Compare pages come from, and what to do when a number looks wrong.

Sources

Model specifications and prices are read from two independent catalogs:

• OpenRouter — a routing API that lists context window, modality support, tool-use and structured-output support, and pricing for models from many vendors.
• LiteLLM — an open-source price and context-window catalog used by developers to configure many providers through one interface.

Where a page cites the vendor’s own pricing or documentation page directly, that source is marked vendor; OpenRouter and LiteLLM entries are marked independent, since they are compiled by a third party rather than the model’s own maker.

Cross-checking

Every price is compared between OpenRouter and LiteLLM. When the two disagree by more than 1%, the model page shows every value found, with its source and the date it was read, instead of picking one silently. A model’s page can also cite the vendor’s own pricing page directly, which sometimes differs again — see, for example, the pricing table on GPT-5.6 Sol, where OpenRouter, LiteLLM and the vendor’s own docs did not all agree at the time it was checked.

What is derived rather than sourced

A few figures are calculated rather than read from a source, and are marked derived: for example, the cost of a “typical request” (1,000 input and 500 output tokens) is calculated from the listed input and output prices, not published by any vendor directly.

Update frequency

Prices and specifications are refreshed regularly rather than on a fixed schedule; the date shown next to each observation is when it was last checked, not when the model itself was released.

Benchmarks

Independent benchmark scores (coding, reasoning, output speed) are not yet included. They will be added only from independent leaderboards, each with its own source and test date — never a vendor’s own claimed score.

Something looks wrong

If a price, limit or capability on a model page looks outdated or incorrect, please use the contact page with a link to the page and, if possible, the source you’re comparing it against.