Skip to main content

Human ratings

Expert (human ratings)

A category computed only from questions judged to be the kind asked by experts at the forefront of their field.

How to read this table

  • Higher rows are rated higher. A range like “1–2” means the gap is within the margin of error.
  • The rating comes from people comparing two answers and picking the better one.
  • At a gap of 50, the higher model is picked about 57% of the time; 100 means 64%, 200 means 76%.
  • Prices are a guide per million tokens, reading then writing.
  • Length is how much text the model can read at once (tokens).

± range of the top model

RankModelDeveloperratingrating scale 1450 to 1600Week
change
OverallInput $
/1M
Output $
/1M
ContextSupportsWeightsReleasedPrice and specs
1–12Claude Fable 5AnthropicRating 1550 ±9−11503rank 2–9$10$501MAnthropic Released 2026-⁠06 Week change −1 Price $10 / $50 Length 1M
1–16Claude Opus 4.6AnthropicRating 1544 ±8−21503rank 2–9$5$251MAnthropic Released 2026-⁠02 Week change −2 Price $5 / $25 Length 1M
1–27Claude Opus 5.5AnthropicRating 1539 ±1801509rank 1–7$4$201MAnthropic Released 2026-⁠09 Price $4 / $20 Length 1M
1–19Claude Opus 5AnthropicRating 1538 ±8−21491rank 8–22$5$251MAnthropic Released 2026-⁠07 Week change −2 Price $5 / $25 Length 1M
1–29Gemini 4 ArgonGoogleRating 1537 ±19−51517rank 1–3$2$101.05MGoogle Released 2026-⁠09 Week change −5 Price $2 / $10 Length 1.05M
1–30Claude Sonnet 5.5AnthropicRating 1535 ±19−51478rank 14–44$2$101MAnthropic Released 2026-⁠09 Week change −5 Price $2 / $10 Length 1M
1–22Claude Opus 4.7AnthropicRating 1534 ±801501rank 2–10$5$251MAnthropic Released 2026-⁠04 Price $5 / $25 Length 1M
1–29Claude Fable 5.1AnthropicRating 1533 ±16+91503rank 2–10$10$501MAnthropic Released 2026-⁠09 Week change +9 Price $10 / $50 Length 1M
1–23GPT-5.6 SolOpenAIRating 1532 ±9−11485rank 10–30$4$201.05MOpenAI Released 2026-⁠07 Week change −1 Price $4 / $20 Length 1.05M
1–26Kimi K3⁠MoonshotRating 1532 ±11−11487rank 8–27$3$151.05MMoonshot Released 2026-⁠07 Week change −1 Price $3 / $15 Length 1.05M
1–55MiMo-V2.6 Pro⁠XiaomiRating 1528 ±27−11480rank 10–44$0.435$0.871.05MXiaomi Released 2026-⁠09 Week change −1 Price $0.435 / $0.87 Length 1.05M
2–29Gemini 3.8 FlashGoogleRating 1528 ±9+31496rank 4–15$0.75$3.751.05MGoogle Released 2026-⁠09 Week change +3 Price $0.75 / $3.75 Length 1.05M
2–32Muse Spark 1.3MetaRating 1527 ±13−21496rank 3–15$1.25$4.251.05MMeta Released 2026-⁠09 Week change −2 Price $1.25 / $4.25 Length 1.05M
3–29Claude Opus 4.8AnthropicRating 1526 ±801481rank 12–36$5$251MAnthropic Released 2026-⁠05 Price $5 / $25 Length 1M
1–54Muse WonderMetaRating 1526 ±23+131509rank 1–8$4$201.05MMeta Released 2026-⁠10 Week change +13 Price $4 / $20 Length 1.05M
4–46Gemini 3.7 FlashGoogleRating 1517 ±11+51490rank 8–25$0.75$3.751.05MGoogle Released 2026-⁠08 Week change +5 Price $0.75 / $3.75 Length 1.05M
4–50GLM-5.3⁠Z.aiRating 1517 ±12−21481rank 11–38$1.4$4.41MZ.ai Released 2026-⁠08 Week change −2 Price $1.4 / $4.4 Length 1M
2–62GPT-6.1 SolOpenAIRating 1516 ±21−41480rank 10–41$2$101.05MOpenAI Released 2026-⁠09 Week change −4 Price $2 / $10 Length 1.05M
3–57GPT-6 AstraOpenAIRating 1516 ±16+71476rank 17–44$10$501.05MOpenAI Released 2026-⁠09 Week change +7 Price $10 / $50 Length 1.05M
3–55DeepSeek-V4.1 Flash⁠DeepSeekRating 1516 ±15−41476rank 17–46——1MDeepSeek Released 2026-⁠09 Week change −4 Price — Length 1M
6–48GPT-5.4OpenAIRating 1514 ±801475rank 19–42$2.5$151.05MOpenAI Released 2026-⁠03 Price $2.5 / $15 Length 1.05M
8–53GPT-5.5OpenAIRating 1512 ±801482rank 12–36$5$301.05MOpenAI Released 2026-⁠04 Price $5 / $30 Length 1.05M
6–55Qwen3.8 MaxAlibabaRating 1512 ±11−11483rank 10–36$2$61MAlibaba Released 2026-⁠08 Week change −1 Price $2 / $6 Length 1M
8–54Claude Sonnet 5AnthropicRating 1511 ±801461rank 41–64$2$101MAnthropic Released 2026-⁠06 Price $2 / $10 Length 1M
7–55GLM-5.3 Flash⁠Z.aiRating 1511 ±10+11476rank 19–43$0.15$0.51MZ.ai Released 2026-⁠08 Week change +1 Price $0.15 / $0.5 Length 1M
13–54Gemini 3.1 Pro (preview)GoogleRating 1509 ±601487rank 10–26$2$121.05MGoogle Released 2026-⁠02 Price $2 / $12 Length 1.05M
12–59GPT-5.6 TerraOpenAIRating 1507 ±9+11467rank 28–53$2$121.05MOpenAI Released 2026-⁠07 Week change +1 Price $2 / $12 Length 1.05M
2–92Qwen3.7 Max (preview)AlibabaRating 1507 ±31+11474rank 15–53————Alibaba Released — Week change +1 Price — Length —
14–59Claude Sonnet 4.6AnthropicRating 1506 ±801472rank 24–49$3$151MAnthropic Released 2026-⁠02 Price $3 / $15 Length 1M
14–59MiMo-V2.5 Pro⁠XiaomiRating 1505 ±8−11466rank 34–53$0.435$0.871.05MXiaomi Released 2026-⁠04 Week change −1 Price $0.435 / $0.87 Length 1.05M
13–68Claude Opus 4.5AnthropicRating 1503 ±1201474rank 23–46$5$25200KAnthropic Released 2025-⁠11 Price $5 / $25 Length 200K
14–65Muse Spark 1.1MetaRating 1502 ±901490rank 8–23$1.25$4.251MMeta Released 2026-⁠07 Price $1.25 / $4.25 Length 1M
14–68Kimi K2.6⁠MoonshotRating 1502 ±10−11461rank 41–65$0.95$4262.1KMoonshot Released 2026-⁠04 Week change −1 Price $0.95 / $4 Length 262.1K
14–67GLM-5.2⁠Z.aiRating 1502 ±901475rank 19–43$1.4$4.41MZ.ai Released 2026-⁠06 Price $1.4 / $4.4 Length 1M
5–94Qwen3.6 Max (preview)AlibabaRating 1500 ±25+11461rank 36–72$1.3$7.8240KAlibaba Released 2026-⁠04 Week change +1 Price $1.3 / $7.8 Length 240K
14–68Gemini 3.6 FlashGoogleRating 1500 ±1001483rank 10–35$0.75$3.751.05MGoogle Released 2026-⁠07 Price $0.75 / $3.75 Length 1.05M
14–72Gemini 3 ProGoogleRating 1499 ±1101486rank 10–29——1.05MGoogle Released 2025-⁠11 Price — Length 1.05M
14–74Qwen3.5 Max (preview)AlibabaRating 1499 ±1301465rank 36–60————Alibaba Released — Price — Length —
6–99Gemma 4 31B⁠GoogleRating 1498 ±2501452rank 48–85——262.1KGoogle Released 2026-⁠04 Price — Length 262.1K
16–69Claude Sonnet 4.5AnthropicRating 1498 ±801456rank 49–69$3$15200KAnthropic Released 2025-⁠09 Price $3 / $15 Length 200K
How to read this page
  • An LLM makes the judgment from the question text alone, without looking at the answers.
  • These ratings exclude the effect of response length and formatting. Differences where the ± ranges overlap are within the margin of error, so about the same.
  • In the Supports column the icons are, from left: can use tools / can read images / can answer in a fixed format (JSON); faded means not supported or unknown.
  • Open-weights models have their contents (the weights) published, so you can also run them on your own computer or server. Models without the open-weights mark are normally used through the developer's own services (apps or API); for some models the weights status is unknown.
  • Names such as ChatGPT next to a model are the consumer services its developer offers. Check on the service itself whether that model is available there.

Data: Arena, Epoch AI, Swallow LLM team (CC BY 4.0), Models.dev (MIT), updated 2026-⁠10-⁠24, data sources