Skip to main content

Human ratings

Quantitative work (human ratings)

Among the occupational fields questions are sorted into, a category computed only from questions in quantitative work.

How to read this table

  • Higher rows are rated higher. A range like “1–2” means the gap is within the margin of error.
  • The rating comes from people comparing two answers and picking the better one.
  • At a gap of 50, the higher model is picked about 57% of the time; 100 means 64%, 200 means 76%.
  • Prices are a guide per million tokens, reading then writing.
  • Length is how much text the model can read at once (tokens).

± range of the top model

RankModelDeveloperratingrating scale 1400 to 1600Week
change
OverallInput $
/1M
Output $
/1M
ContextSupportsWeightsReleasedPrice and specs
1–19Gemini 4 ArgonGoogleRating 1540 ±23−91517rank 1–3$2$101.05MGoogle Released 2026-⁠09 Week change −9 Price $2 / $10 Length 1.05M
1–26GPT-6.1 SolOpenAIRating 1538 ±26+81480rank 10–41$2$101.05MOpenAI Released 2026-⁠09 Week change +8 Price $2 / $10 Length 1.05M
1–21Claude Fable 5.1AnthropicRating 1535 ±20+81503rank 2–10$10$501MAnthropic Released 2026-⁠09 Week change +8 Price $10 / $50 Length 1M
1–16Claude Opus 5AnthropicRating 1532 ±10−21491rank 8–22$5$251MAnthropic Released 2026-⁠07 Week change −2 Price $5 / $25 Length 1M
1–23Claude Opus 4.6AnthropicRating 1524 ±10−11503rank 2–9$5$251MAnthropic Released 2026-⁠02 Week change −1 Price $5 / $25 Length 1M
1–52Muse WonderMetaRating 1519 ±30New1509rank 1–8$4$201.05MMeta Released 2026-⁠10 Price $4 / $20 Length 1.05M
1–30Claude Fable 5AnthropicRating 1519 ±1201503rank 2–9$10$501MAnthropic Released 2026-⁠06 Price $10 / $50 Length 1M
1–46Claude Opus 5.5AnthropicRating 1517 ±23+121509rank 1–7$4$201MAnthropic Released 2026-⁠09 Week change +12 Price $4 / $20 Length 1M
1–33Claude Opus 4.7AnthropicRating 1515 ±11−11501rank 2–10$5$251MAnthropic Released 2026-⁠04 Week change −1 Price $5 / $25 Length 1M
1–39Gemini 3.8 FlashGoogleRating 1514 ±12+51496rank 4–15$0.75$3.751.05MGoogle Released 2026-⁠09 Week change +5 Price $0.75 / $3.75 Length 1.05M
1–53Claude Sonnet 5.5AnthropicRating 1513 ±26−71478rank 14–44$2$101MAnthropic Released 2026-⁠09 Week change −7 Price $2 / $10 Length 1M
1–43GPT-5.6 SolOpenAIRating 1512 ±1301485rank 10–30$4$201.05MOpenAI Released 2026-⁠07 Price $4 / $20 Length 1.05M
1–45Kimi K3⁠MoonshotRating 1508 ±14−31487rank 8–27$3$151.05MMoonshot Released 2026-⁠07 Week change −3 Price $3 / $15 Length 1.05M
2–45Claude Opus 4.8AnthropicRating 1506 ±11−11481rank 12–36$5$251MAnthropic Released 2026-⁠05 Week change −1 Price $5 / $25 Length 1M
3–45GPT-5.5OpenAIRating 1506 ±1001482rank 12–36$5$301.05MOpenAI Released 2026-⁠04 Price $5 / $30 Length 1.05M
1–62GPT-6 AstraOpenAIRating 1503 ±21+71476rank 17–44$10$501.05MOpenAI Released 2026-⁠09 Week change +7 Price $10 / $50 Length 1.05M
1–88MiMo-V2.6 Pro⁠XiaomiRating 1502 ±3801480rank 10–44$0.435$0.871.05MXiaomi Released 2026-⁠09 Price $0.435 / $0.87 Length 1.05M
3–62Muse Spark 1.3MetaRating 1500 ±17−11496rank 3–15$1.25$4.251.05MMeta Released 2026-⁠09 Week change −1 Price $1.25 / $4.25 Length 1.05M
6–52GPT-5.4OpenAIRating 1499 ±1101475rank 19–42$2.5$151.05MOpenAI Released 2026-⁠03 Price $2.5 / $15 Length 1.05M
6–54Muse Spark 1.1MetaRating 1498 ±12−11490rank 8–23$1.25$4.251MMeta Released 2026-⁠07 Week change −1 Price $1.25 / $4.25 Length 1M
5–61Gemini 3.7 FlashGoogleRating 1498 ±1401490rank 8–25$0.75$3.751.05MGoogle Released 2026-⁠08 Price $0.75 / $3.75 Length 1.05M
5–62GLM-5.3⁠Z.aiRating 1497 ±16−71481rank 11–38$1.4$4.41MZ.ai Released 2026-⁠08 Week change −7 Price $1.4 / $4.4 Length 1M
6–62GLM-5.3 Flash⁠Z.aiRating 1496 ±13+21476rank 19–43$0.15$0.51MZ.ai Released 2026-⁠08 Week change +2 Price $0.15 / $0.5 Length 1M
4–66DeepSeek-V4.1 Flash⁠DeepSeekRating 1496 ±19+11476rank 17–46——1MDeepSeek Released 2026-⁠09 Week change +1 Price — Length 1M
7–62GLM-5.2⁠Z.aiRating 1494 ±11+21475rank 19–43$1.4$4.41MZ.ai Released 2026-⁠06 Week change +2 Price $1.4 / $4.4 Length 1M
7–62Grok 4.5xAIRating 1494 ±1301466rank 33–55$2$6500KxAI Released 2026-⁠07 Price $2 / $6 Length 500K
5–74Tencent HY3⁠TencentRating 1493 ±21+11454rank 48–76——256KTencent Released 2026-⁠07 Week change +1 Price — Length 256K
7–66Qwen3.8 MaxAlibabaRating 1491 ±1401483rank 10–36$2$61MAlibaba Released 2026-⁠08 Price $2 / $6 Length 1M
8–64GPT-5.6 TerraOpenAIRating 1491 ±12−11467rank 28–53$2$121.05MOpenAI Released 2026-⁠07 Week change −1 Price $2 / $12 Length 1.05M
4–87Muse Spark 1.2MetaRating 1491 ±2501491rank 6–25$1.25$4.251.05MMeta Released 2026-⁠08 Price $1.25 / $4.25 Length 1.05M
9–62MiMo-V2.5 Pro⁠XiaomiRating 1490 ±10−11466rank 34–53$0.435$0.871.05MXiaomi Released 2026-⁠04 Week change −1 Price $0.435 / $0.87 Length 1.05M
8–66Gemini 3.6 FlashGoogleRating 1489 ±1301483rank 10–35$0.75$3.751.05MGoogle Released 2026-⁠07 Price $0.75 / $3.75 Length 1.05M
8–68ERNIE 5.1BaiduRating 1489 ±1401467rank 26–53——119K—Baidu Released — Price — Length 119K
9–66Gemini 3.5 FlashGoogleRating 1489 ±12−11477rank 18–41$1.5$91.05MGoogle Released 2026-⁠05 Week change −1 Price $1.5 / $9 Length 1.05M
2–96Qwen3.6 Max (preview)AlibabaRating 1489 ±3001461rank 36–72$1.3$7.8240KAlibaba Released 2026-⁠04 Price $1.3 / $7.8 Length 240K
9–65Claude Sonnet 5AnthropicRating 1489 ±1101461rank 41–64$2$101MAnthropic Released 2026-⁠06 Price $2 / $10 Length 1M
8–76Qwen3.5 Max (preview)AlibabaRating 1486 ±1601465rank 36–60————Alibaba Released — Price — Length —
9–74Grok 4.6xAIRating 1486 ±1401456rank 48–72$2$6500KxAI Released 2026-⁠08 Price $2 / $6 Length 500K
1–107Beam 1.0 501B A23B⁠reflectionRating 1486 ±36New1436rank 68–116——262.1Kreflection Released 2026-⁠10 Price — Length 262.1K
14–64Gemini 3.1 Pro (preview)GoogleRating 1485 ±801487rank 10–26$2$121.05MGoogle Released 2026-⁠02 Price $2 / $12 Length 1.05M
How to read this page
  • These ratings exclude the effect of response length and formatting. Differences where the ± ranges overlap are within the margin of error, so about the same.
  • In the Supports column the icons are, from left: can use tools / can read images / can answer in a fixed format (JSON); faded means not supported or unknown.
  • Open-weights models have their contents (the weights) published, so you can also run them on your own computer or server. Models without the open-weights mark are normally used through the developer's own services (apps or API); for some models the weights status is unknown.
  • Names such as ChatGPT next to a model are the consumer services its developer offers. Check on the service itself whether that model is available there.

Data: Arena, Epoch AI, Swallow LLM team (CC BY 4.0), Models.dev (MIT), updated 2026-⁠10-⁠24, data sources