BabyVision (with tools)

Basic visual reasoning (with tools).

Category: Multimodal
Unit: Percent (%); Higher is better
Comparison groups: 3total; All model rankings (records) · Ranked results: 3

All model rankings (records)

These rankings are recalculated by comparison group including legacy models and models unavailable in Claude Code / Codex. They differ from the rankings above because the set of models differs.

Show rankings including legacy and unavailable models (entries: 3)

official results (Kimi K3.1 Pro (Hugging Face model card, moonshotai))

Rank	Model	effort	Score	Source cost (metric)	measured/reported by	source
1	Kimi K3.1 Pro	Max	95.4%	—	Moonshot AI	Kimi K3.1 Pro (Hugging Face model card, moonshotai)Retrieved 2026-11-13 · Vendor-reported value (self-reported by Moonshot AI). Table column heading Kimi K3.1 Pro (max), table note: all Kimi K3.1 Pro results use reasoning effort max, temperature 1.0, top-p 0.95. With tools (Python); average of 4 runs. Source excerpt BabyVision w/ python \| 95.4Location HF model card "3. Evaluation Results" table, BabyVision w/ python row, Kimi K3.1 Pro (max) column (leftmost numeric column). Supporting footnote: Agentic 11

official results (Kimi K3 (Hugging Face model card, moonshotai))

Rank	Model	effort	Score	Source cost (metric)	measured/reported by	source
1	Kimi K3	Max	85.7%	—	Moonshot AI	Kimi K3 (Hugging Face model card, moonshotai)Retrieved 2026-11-13 · Vendor-reported value (self-reported by Moonshot AI). Table note: All Kimi K3 results are obtained with reasoning effort set to 'max' and temperature = 1.0. With tools (Python). Source excerpt BabyVision w/ python \| 85.7Location HF model card "3. Evaluation Results" table, BabyVision w/ python row, Kimi K3 (max) column (leftmost numeric column). Supporting footnote: Multimodal (average of 3 runs)

official results (DeepSeek-V4.1-Flash (Hugging Face model card, deepseek-ai))

Rank	Model	effort	Score	Source cost (metric)	measured/reported by	source
1	DeepSeek-V4.1-Flash	not stated	89.6%	—	DeepSeek	DeepSeek-V4.1-Flash (Hugging Face model card, deepseek-ai)Retrieved 2026-11-13 · Vendor-reported value (self-reported by DeepSeek). Card "Instruct Model": All instruct results below use the maximum effort setting (reasoning_effort=100), temperature=1.0, top_p=0.95. The correspondence of reasoning_effort=100 to the API effort names (low/high/max) has no official statement, so effort is null. Evaluated with the Claude Code harness and 512k context. Source excerpt BabyVision w/ tools (Pass@1) \| 89.6Location HF model card "Comparison with frontier models (Max reasoning effort)" table, BabyVision w/ tools (Pass@1) row, DS-V4.1-Flash column (rightmost)