Chartography (with tools)
Accuracy in reading charts and figures (with tools).
- Category
- Multimodal
- Unit
- Percent (%)
- Higher is better
- Comparison groups
- 4total
- Currently available model rankings · Ranked results: 4
- All models (records): Groups: 6 · Entries: 8
Rankings
Values with different source types (official, third-party, paper) or measurement conditions cannot be compared, so rankings are separated by comparison group (the same source, or sources verified to use the same conditions).
Rankings include only models currently available in Claude Code / Codex, excluding legacy models.
official results (Introducing Claude Opus 5.5)
| Rank | Model | effort | Score | Source cost (metric) | measured/reported by | source |
|---|---|---|---|---|---|---|
| 1 | Claude Opus 5.5 | Max | 89.0% | — | Anthropic | Introducing Claude Opus 5.5Retrieved 2026-11-12 · Vendor-reported value. table note: Unless otherwise noted, all Claude Opus 5.5 results use adaptive thinking at max effort. production safeguards enabled.Source excerpt89.0%Location Table, Chartography (with tools) row: 89.0 |
official results (Claude Fable 5.2 and Claude Mythos 5.2 System Card)
| Rank | Model | effort | Score | Source cost (metric) | measured/reported by | source |
|---|---|---|---|---|---|---|
| 1 | Claude Fable 5.2 | Max | 91.6% | — | Anthropic | Claude Fable 5.2 and Claude Mythos 5.2 System CardRetrieved 2026-11-14 · Vendor-reported value. Run internally by Anthropic. adaptive thinking, max, with tools, averaged over 5 runs. The grader is Gemini 3.5 Flash. Cost not stated.Source excerpt91.6%Location §8.13.1 “Chartography”, body text, Fable 5.2 with tools score |
official results (Claude Sonnet 5.5 System Card)
| Rank | Model | effort | Score | Source cost (metric) | measured/reported by | source |
|---|---|---|---|---|---|---|
| 1 | Claude Sonnet 5.5 | Max | 90.2% | — | Anthropic | Claude Sonnet 5.5 System CardRetrieved 2026-11-14 · Vendor-reported value. Run internally by Anthropic. adaptive thinking, max, with tools, averaged over 5 runs. The grader is Gemini 3.5 Flash. Cost not stated.Source excerpt90.2%Location §8.13.1 “Chartography”, body text, own model with tools score |
official results (Claude Haiku 5.5 System Card)
| Rank | Model | effort | Score | Source cost (metric) | measured/reported by | source |
|---|---|---|---|---|---|---|
| 1 | Claude Haiku 5.5 | Max | 86.2% | — | Anthropic | Claude Haiku 5.5 System CardRetrieved 2026-11-14 · Vendor-reported value. Run internally by Anthropic. adaptive thinking, max, with tools, averaged over 5 runs. The grader is Gemini 3.5 Flash. Cost not stated.Source excerpt86.2%Location §8.9.1 “Chartography”, body text, own model with tools score |
All model rankings (records)
These rankings are recalculated by comparison group including legacy models and models unavailable in Claude Code / Codex. They differ from the rankings above because the set of models differs.
Show rankings including legacy and unavailable models (entries: 8)
official results (Introducing Claude Opus 5.5)
| Rank | Model | effort | Score | Source cost (metric) | measured/reported by | source |
|---|---|---|---|---|---|---|
| 1 | Claude Opus 5.5 | Max | 89.0% | — | Anthropic | Introducing Claude Opus 5.5Retrieved 2026-11-12 · Vendor-reported value. table note: Unless otherwise noted, all Claude Opus 5.5 results use adaptive thinking at max effort. production safeguards enabled.Source excerpt89.0%Location Table, Chartography (with tools) row: 89.0 |
| 2 | Claude Fable 5.1 | not stated | 88.4% | — | Anthropic | Introducing Claude Opus 5.5Retrieved 2026-11-12 · Vendor-reported value. table note: Unless otherwise noted, all Claude Opus 5.5 results use adaptive thinking at max effort. production safeguards enabled.Source excerpt88.4%Location Table, Chartography (with tools) row: 88.4 |
| 3 | Claude Opus 5 | not stated | 83.4% | — | Anthropic | Introducing Claude Opus 5.5Retrieved 2026-11-12 · Vendor-reported value. table note: Unless otherwise noted, all Claude Opus 5.5 results use adaptive thinking at max effort. production safeguards enabled.Source excerpt83.4%Location Table, Chartography (with tools) row: 83.4 |
official results (Kimi K3.1 Pro (Hugging Face model card, moonshotai))
| Rank | Model | effort | Score | Source cost (metric) | measured/reported by | source |
|---|---|---|---|---|---|---|
| 1 | Kimi K3.1 Pro | Max | 90.2% | — | Moonshot AI | Kimi K3.1 Pro (Hugging Face model card, moonshotai)Retrieved 2026-11-13 · Vendor-reported value (self-reported by Moonshot AI). Table column heading Kimi K3.1 Pro (max), table note: all Kimi K3.1 Pro results use reasoning effort max, temperature 1.0, top-p 0.95. With tools (Python); average of 5 runs.Source excerptChartoGraphy w/ python | 90.2Location HF model card "3. Evaluation Results" table, ChartoGraphy w/ python row, Kimi K3.1 Pro (max) column (leftmost numeric column). Supporting footnote: Agentic 11 |
official results (DeepSeek-V4.1-Flash (Hugging Face model card, deepseek-ai))
| Rank | Model | effort | Score | Source cost (metric) | measured/reported by | source |
|---|---|---|---|---|---|---|
| 1 | DeepSeek-V4.1-Flash | not stated | 78.9% | — | DeepSeek | DeepSeek-V4.1-Flash (Hugging Face model card, deepseek-ai)Retrieved 2026-11-13 · Vendor-reported value (self-reported by DeepSeek). Card "Instruct Model": All instruct results below use the maximum effort setting (reasoning_effort=100), temperature=1.0, top_p=0.95. The correspondence of reasoning_effort=100 to the API effort names (low/high/max) has no official statement, so effort is null. Evaluated with the Claude Code harness and 512k context.Source excerptChartography w/ tools (Pass@1) | 78.9Location HF model card "Comparison with frontier models (Max reasoning effort)" table, Chartography w/ tools (Pass@1) row, DS-V4.1-Flash column (rightmost) |
official results (Claude Fable 5.2 and Claude Mythos 5.2 System Card)
| Rank | Model | effort | Score | Source cost (metric) | measured/reported by | source |
|---|---|---|---|---|---|---|
| 1 | Claude Fable 5.2 | Max | 91.6% | — | Anthropic | Claude Fable 5.2 and Claude Mythos 5.2 System CardRetrieved 2026-11-14 · Vendor-reported value. Run internally by Anthropic. adaptive thinking, max, with tools, averaged over 5 runs. The grader is Gemini 3.5 Flash. Cost not stated.Source excerpt91.6%Location §8.13.1 “Chartography”, body text, Fable 5.2 with tools score |
official results (Claude Sonnet 5.5 System Card)
| Rank | Model | effort | Score | Source cost (metric) | measured/reported by | source |
|---|---|---|---|---|---|---|
| 1 | Claude Sonnet 5.5 | Max | 90.2% | — | Anthropic | Claude Sonnet 5.5 System CardRetrieved 2026-11-14 · Vendor-reported value. Run internally by Anthropic. adaptive thinking, max, with tools, averaged over 5 runs. The grader is Gemini 3.5 Flash. Cost not stated.Source excerpt90.2%Location §8.13.1 “Chartography”, body text, own model with tools score |
official results (Claude Haiku 5.5 System Card)
| Rank | Model | effort | Score | Source cost (metric) | measured/reported by | source |
|---|---|---|---|---|---|---|
| 1 | Claude Haiku 5.5 | Max | 86.2% | — | Anthropic | Claude Haiku 5.5 System CardRetrieved 2026-11-14 · Vendor-reported value. Run internally by Anthropic. adaptive thinking, max, with tools, averaged over 5 runs. The grader is Gemini 3.5 Flash. Cost not stated.Source excerpt86.2%Location §8.9.1 “Chartography”, body text, own model with tools score |