Skip to main content

Reported by others

Reading PDFs (GDP.pdf)

The model reads real-world PDF documents with tables and figures and answers questions about their contents.

How to read this table

  • Higher rows are rated higher. A range like “1–2” means the gap is within the margin of error.
  • The score is the value published by the task's authors and other organizations.
  • Conditions can differ between models, so small gaps do not mean much.
  • Prices are a guide per million tokens, reading then writing.
  • Length is how much text the model can read at once (tokens).
RankModelDeveloperAccuracy
(%)
Accuracy scale 0 to 40
Input $
/1M
Output $
/1M
ContextSupportsWeightsReleasedPrice and specs
1GPT-6.1 SolOpenAIRating 35.0$2$101.05MOpenAI Released 2026-⁠09 Price $2 / $10 Length 1.05M
2GPT-6 AstraOpenAIRating 34.2$10$501.05MOpenAI Released 2026-⁠09 Price $10 / $50 Length 1.05M
3Claude Sonnet 5.5AnthropicRating 31.4$2$101MAnthropic Released 2026-⁠09 Price $2 / $10 Length 1M
4Muse WonderMetaRating 30.8$4$201.05MMeta Released 2026-⁠10 Price $4 / $20 Length 1.05M
5GPT-5.6 SolOpenAIRating 30.7$4$201.05MOpenAI Released 2026-⁠07 Price $4 / $20 Length 1.05M
6Claude Opus 5.5AnthropicRating 30.6$4$201MAnthropic Released 2026-⁠09 Price $4 / $20 Length 1M
7Claude Fable 5AnthropicRating 30.0$10$501MAnthropic Released 2026-⁠06 Price $10 / $50 Length 1M
8Claude Fable 5.1AnthropicRating 29.6$10$501MAnthropic Released 2026-⁠09 Price $10 / $50 Length 1M
9Gemini 4 ArgonGoogleRating 28.4$2$101.05MGoogle Released 2026-⁠09 Price $2 / $10 Length 1.05M
10Muse Spark 1.3MetaRating 27.6$1.25$4.251.05MMeta Released 2026-⁠09 Price $1.25 / $4.25 Length 1.05M
11GPT-6 SolOpenAIRating 26.4$2$101.05MOpenAI Released 2026-⁠09 Price $2 / $10 Length 1.05M
12GPT-5.5OpenAIRating 26.0$5$301.05MOpenAI Released 2026-⁠04 Price $5 / $30 Length 1.05M
13GPT-5.6 TerraOpenAIRating 24.7$2$121.05MOpenAI Released 2026-⁠07 Price $2 / $12 Length 1.05M
14–15Claude Opus 4.8AnthropicRating 24.0$5$251MAnthropic Released 2026-⁠05 Price $5 / $25 Length 1M
14–15Claude Opus 5AnthropicRating 24.0$5$251MAnthropic Released 2026-⁠07 Price $5 / $25 Length 1M
16Gemini 3.7 FlashGoogleRating 23.8$0.75$3.751.05MGoogle Released 2026-⁠08 Price $0.75 / $3.75 Length 1.05M
17Gemini 3.8 FlashGoogleRating 23.4$0.75$3.751.05MGoogle Released 2026-⁠09 Price $0.75 / $3.75 Length 1.05M
18Qwen3.8 MaxAlibabaRating 23.2$2$61MAlibaba Released 2026-⁠08 Price $2 / $6 Length 1M
19GPT-6 LunaOpenAIRating 23.0$0.1$0.51.05MOpenAI Released 2026-⁠09 Price $0.1 / $0.5 Length 1.05M
20Grok 4.7xAIRating 22.8$2$6500KxAI Released 2026-⁠09 Price $2 / $6 Length 500K
21GPT-5.6 LunaOpenAIRating 22.7$0.2$1.21.05MOpenAI Released 2026-⁠07 Price $0.2 / $1.2 Length 1.05M
22Claude Opus 4.7AnthropicRating 21.0$5$251MAnthropic Released 2026-⁠04 Price $5 / $25 Length 1M
23DeepSeek-V4.1 Flash⁠DeepSeekRating 19.8——1MDeepSeek Released 2026-⁠09 Price — Length 1M
24Kimi K3⁠MoonshotRating 19.0$3$151.05MMoonshot Released 2026-⁠07 Price $3 / $15 Length 1.05M
25Claude Sonnet 4.6AnthropicRating 18.0$3$151MAnthropic Released 2026-⁠02 Price $3 / $15 Length 1M
26Grok 4.6xAIRating 17.2$2$6500KxAI Released 2026-⁠08 Price $2 / $6 Length 500K
27Gemini 3.1 Pro (preview)GoogleRating 17.0$2$121.05MGoogle Released 2026-⁠02 Price $2 / $12 Length 1.05M
28Qwen3.8 FlashAlibabaRating 16.6$0.15$0.471MAlibaba Released 2026-⁠08 Price $0.15 / $0.47 Length 1M
29Muse Spark 1.2MetaRating 16.0$1.25$4.251.05MMeta Released 2026-⁠08 Price $1.25 / $4.25 Length 1.05M
30Muse Spark 1.1MetaRating 15.0$1.25$4.251MMeta Released 2026-⁠07 Price $1.25 / $4.25 Length 1M
31–34Gemini 3.5 FlashGoogleRating 14.0$1.5$91.05MGoogle Released 2026-⁠05 Price $1.5 / $9 Length 1.05M
31–34Gemini 3.6 FlashGoogleRating 14.0$0.75$3.751.05MGoogle Released 2026-⁠07 Price $0.75 / $3.75 Length 1.05M
31–34GLM-5.3 Flash⁠Z.aiRating 14.0$0.15$0.51MZ.ai Released 2026-⁠08 Price $0.15 / $0.5 Length 1M
31–34Grok 4.5xAIRating 14.0$2$6500KxAI Released 2026-⁠07 Price $2 / $6 Length 500K
35Kimi K2.6⁠MoonshotRating 12.0$0.95$4262.1KMoonshot Released 2026-⁠04 Price $0.95 / $4 Length 262.1K
36–37Gemini 3.5 Flash-LiteGoogleRating 10.0$0.3$2.51.05MGoogle Released 2026-⁠07 Price $0.3 / $2.5 Length 1.05M
36–37Gemini 3 Flash (preview)GoogleRating 10.0$0.5$31MGoogle Released 2025-⁠12 Price $0.5 / $3 Length 1M
38Grok 4.3xAIRating 8.0$1.25$2.51MxAI Released 2026-⁠04 Price $1.25 / $2.5 Length 1M
39Amazon Nova 2 Pro (preview)AmazonRating 2.0———Amazon Released 2025-⁠12 Price — Length —

Best accuracy over time

2025-12-02Release date2026-10-12
How to read this page
  • The value is the share answered correctly. Figures published by the organizations that made the tasks, among others, collected here.
  • The accuracy is the share of problems solved. A gap of 1 point is 1 question out of 100.
  • In the Supports column the icons are, from left: can use tools / can read images / can answer in a fixed format (JSON); faded means not supported or unknown.
  • Open-weights models have their contents (the weights) published, so you can also run them on your own computer or server. Models without the open-weights mark are normally used through the developer's own services (apps or API); for some models the weights status is unknown.
  • Names such as ChatGPT next to a model are the consumer services its developer offers. Check on the service itself whether that model is available there.

Data: Arena, Epoch AI, Swallow LLM team (CC BY 4.0), Models.dev (MIT), updated 2026-⁠10-⁠24, data sources