Skip to main content

Think

Choosing an LLM for math and logic

Ranked by human ratings on math problems with definite answers.

Highest rated
△Gemini 4 Argon $4
On a budget
GLM-5.3 Flash Z.ai Open weights $0.24
Rating gap 28
Within the margin of error, so about the same

About the same rating as the cheaper GLM-5.3 Flash ($0.24); the gap is within the margin of error, so GLM-5.3 Flash is enough.

Rating and price

The closer to the top left, the cheaper and better rated the model.

$0.1$1$10$1001250135014501550Gemini 4 ArgonGLM-5.3 FlashGemini 3.8 FlashMiMo-V2.6 FlashStep 3.5 FlashGPT-5 nanoPrice ($ / 1M tokens)Human ratingRecommended model at its priceRecommended model at its priceRecommended model at its priceRecommended model at its priceRecommended model at its priceRecommended model at its price$0.1$1$10$1001250135014501550Gemini 4 ArgonGLM-5.3 FlashPrice ($ / 1M tokens)Human ratingRecommended model at its priceRecommended model at its priceRecommended model at its priceRecommended model at its priceRecommended model at its priceRecommended model at its price

OpenAIGoogleZ.aiXiaomiStepFunAlibabaAnthropicMistralCohereMetaMiniMaxxAIDeepSeekMoonshotNVIDIAMicrosoftOther

Best-rated model at each price

First line: model / Human rating, second line: price estimate

ModelDeveloperHuman ratingPrice
△Gemini 4 ArgonGoogle1532 ±24 △$4 (in $2, out $10)
△Gemini 3.8 FlashGoogle1526 ±13 △$1.5 (in $0.75, out $3.75)
GLM-5.3 Flash⁠Z.ai1504 ±14$0.24 (in $0.15, out $0.5)
MiMo-V2.6 Flash⁠Xiaomi1464 ±21$0.18 (in $0.14, out $0.28)
Step 3.5 Flash⁠StepFun1407 ±10$0.16 (in $0.1046, out $0.3138)
GPT-5 nanoOpenAI1347 ±27$0.14 (in $0.05, out $0.4)

All models (highest human rating first)

Second line: price (input / output) / context / released / supports Tools Image JSON □ Compare

PickCompareModelDeveloperHuman ratingAdvanced
math

(%)
Mock
AIME

(%)
Proofs
(%)
Input $
/1M
Output $
/1M
ContextSupportsWeightsReleasedPrice and specs
Gemini 4 Argon⁠Google1532 ±2490.5100.099.0$2$101.05M$2 / $10 1.05M 2026-09
Claude Fable 5.1Anthropic1529 ±2194.9100.0100.0$10$501M$10 / $50 1M 2026-09
Gemini 3.8 Flash⁠Google1526 ±1372.098.948.0$0.75$3.751.05M$0.75 / $3.75 1.05M 2026-09
Claude Fable 5Anthropic1521 ±1391.6100.095.0$10$501M$10 / $50 1M 2026-06
Claude Opus 5Anthropic1521 ±1190.198.999.0$5$251M$5 / $25 1M 2026-07
Claude Opus 4.6Anthropic1517 ±1069.494.450.0$5$251M$5 / $25 1M 2026-02
GPT-6.1 SolOpenAI1513 ±2698.6100.099.0$2$101.05M$2 / $10 1.05M 2026-09
Claude Opus 5.5Anthropic1512 ±2596.0100.0100.0$4$201M$4 / $20 1M 2026-09
Muse Spark 1.3Meta1510 ±1878.399.258.0$1.25$4.251.05M$1.25 / $4.25 1.05M 2026-09
Gemini 3.7 FlashGoogle1505 ±1575.397.258.0$0.75$3.751.05M$0.75 / $3.75 1.05M 2026-08
Gemini 3.6 FlashGoogle1504 ±1462.094.236.0$0.75$3.751.05M$0.75 / $3.75 1.05M 2026-07
Claude Opus 4.7Anthropic1504 ±1173.997.854.0$5$251M$5 / $25 1M 2026-04
GLM-5.3 Flash⁠⁠Z.ai1504 ±1458.793.921.0$0.15$0.51M$0.15 / $0.5 1M 2026-08
Claude Sonnet 5.5Anthropic1501 ±2793.4100.0100.0$2$101M$2 / $10 1M 2026-09
GPT-5.5OpenAI1501 ±1089.8100.050.0$5$301.05M$5 / $30 1.05M 2026-04
GLM-5.3⁠Z.ai1500 ±1772.491.149.0$1.4$4.41M$1.4 / $4.4 1M 2026-08
Kimi K3⁠Moonshot1499 ±1576.097.287.0$3$151.05M$3 / $15 1.05M 2026-07
Qwen3.8 MaxAlibaba1499 ±1578.799.458.0$2$61M$2 / $6 1M 2026-08
Gemini 3.5 FlashGoogle1497 ±1266.195.631.0$1.5$91.05M$1.5 / $9 1.05M 2026-05
GPT-5.6 SolOpenAI1496 ±1393.8100.083.0$4$201.05M$4 / $20 1.05M 2026-07
Muse WonderMeta1496 ±3186.499.484.0$4$201.05M$4 / $20 1.05M 2026-10
DeepSeek-V4.1 Flash⁠DeepSeek1495 ±2170.998.354.0——1M1M 2026-09
Claude Opus 4.8Anthropic1494 ±1184.298.369.0$5$251M$5 / $25 1M 2026-05
Muse Spark 1.1Meta1493 ±13——39.0$1.25$4.251M$1.25 / $4.25 1M 2026-07
GPT-5.4OpenAI1491 ±1182.797.856.0$2.5$151.05M$2.5 / $15 1.05M 2026-03
Muse Spark 1.2Meta1491 ±25——43.0$1.25$4.251.05M$1.25 / $4.25 1.05M 2026-08
Gemini 3.1 Pro (preview)Google1489 ±862.895.626.0$2$121.05M$2 / $12 1.05M 2026-02
MiMo-V2.6 Pro⁠Xiaomi1489 ±40——70.0$0.435$0.871.05M$0.435 / $0.87 1.05M 2026-09
GLM-5.2⁠Z.ai1488 ±1262.386.435.0$1.4$4.41M$1.4 / $4.4 1M 2026-06
GPT-6 AstraOpenAI1487 ±2198.6100.099.0$10$501.05M$10 / $50 1.05M 2026-09
Qwen3.7 Max (preview)Alibaba1484 ±38———————
Tencent HY3⁠Tencent1484 ±22—————256K256K 2026-07
GPT-5.6 TerraOpenAI1483 ±1390.599.774.0$2$121.05M$2 / $12 1.05M 2026-07
Inkling⁠Thinking Machines1480 ±1335.188.90.0$1.87$4.68262.1K$1.87 / $4.68 262.1K 2026-07
MiMo-V2.5 Pro⁠Xiaomi1479 ±10——22.0$0.435$0.871.05M$0.435 / $0.87 1.05M 2026-04
Kimi K2.6⁠Moonshot1479 ±1360.296.116.0$0.95$4262.1K$0.95 / $4 262.1K 2026-04
GPT-5.6 LunaOpenAI1478 ±1486.498.360.0$0.2$1.21.05M$0.2 / $1.2 1.05M 2026-07
ERNIE 5.1Baidu1478 ±13—————119K—119K
Gemini 3 ProGoogle1477 ±11—————1.05M1.05M 2025-11
GLM-5.1⁠Z.ai1476 ±1138.893.322.2$1.4$4.4200K$1.4 / $4.4 200K 2026-04
How to read this page
  • Also shown (not used for ranking): accuracy on advanced undergraduate to early research math problems, AIME-style math competition problems and math proof problems. 379 models have ratings.
  • Bars are drawn from 800 to 1600.
  • The human rating comes from people giving two models the same question and picking the better answer. With a gap of 50, the higher-rated model is picked about 57% of the time; 64% at 100 and 76% at 200 (a gap of 0 is even odds). Differences where the ± ranges overlap are within the margin of error, so about the same.
  • Only some models have values for Advanced math, Mock AIME, Proofs.
  • Only models rated higher than every cheaper model are listed, best first. For about the same rating, pick the cheapest row in this table. The top row without △ within the price you can pay is the pick. A △ row costs more than the row below it without △, yet its rating is about the same (the gap is within the margin of error).
  • “On a budget” is the highest-rated model at $2 or less per million tokens (or at your price cap, when that is lower).
  • △ marks rows whose rating gap is within the margin of error (about the same). A row without △ is rated higher than the nearest row below it without △, by more than the margin of error.
  • Best at each price
  • Prices are what developers pay to use a model through its API, separate from app subscriptions. The unit is one million tokens. A token is a small piece of text (about three quarters of an English word); one million tokens is roughly 8 to 10 novels. Reading (input) and writing (output) are priced differently; here they are blended 3 : 1. For example, at $4, one everyday question and answer (about 1,000 tokens) costs about 0.4 cents. Models without a known price are left out.
  • In the Supports column the icons are, from left: can use tools / can read images / can answer in a fixed format (JSON); faded means not supported or unknown.
  • Open-weights models have their contents (the weights) published, so you can also run them on your own computer or server. Models without the open-weights mark are normally used through the developer's own services (apps or API); for some models the weights status is unknown.
  • Names such as ChatGPT next to a model are the consumer services its developer offers. Check on the service itself whether that model is available there.
  • Vertical is Human rating, horizontal is price (the horizontal scale gets coarser to the right). Points joined by the step line are the best-rated models at each price. Hover or tap a dot to see the model's name.

Data: Arena, Epoch AI, Swallow LLM team (CC BY 4.0), Models.dev (MIT), updated 2026-⁠10-⁠24, data sources