CyScenarioBench

Cybersecurity scenario evaluation (tasks are specific to each lab).

Category
Other
Unit
Percent (%)
Higher is better
Comparison groups
1total
Currently available model rankings · Ranked results: 1
All models (records): Groups: 1 · Entries: 3

Rankings

Values with different source types (official, third-party, paper) or measurement conditions cannot be compared, so rankings are separated by comparison group (the same source, or sources verified to use the same conditions).

Rankings include only models currently available in Claude Code / Codex, excluding legacy models.

official results (Introducing Claude Fable 5.2 and Claude Mythos 5.2)

RankModeleffortScoreSource cost (metric)measured/reported bysource
1Claude Opus 5.5not stated67.6%—AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. table note: Scores for Fable 5.2, Fable 5.1, and Opus 5.5 show results with safeguards on unless otherwise noted. All scores show each model’s highest-available effort unless otherwise noted. Opus 5.5 without safeguards.
Source excerpt67.6%Location Table, CyScenarioBench row: 67.6% without safeguards

All model rankings (records)

These rankings are recalculated by comparison group including legacy models and models unavailable in Claude Code / Codex. They differ from the rankings above because the set of models differs.

Show rankings including legacy and unavailable models (entries: 3)

official results (Introducing Claude Fable 5.2 and Claude Mythos 5.2)

RankModeleffortScoreSource cost (metric)measured/reported bysource
1Claude Mythos 5.2not stated76.3%—AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. table note: Scores for Fable 5.2, Fable 5.1, and Opus 5.5 show results with safeguards on unless otherwise noted. All scores show each model’s highest-available effort unless otherwise noted.
Source excerpt76.3%Location Table, CyScenarioBench row: 76.3% Mythos 5.2
2Claude Opus 5.5not stated67.6%—AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. table note: Scores for Fable 5.2, Fable 5.1, and Opus 5.5 show results with safeguards on unless otherwise noted. All scores show each model’s highest-available effort unless otherwise noted. Opus 5.5 without safeguards.
Source excerpt67.6%Location Table, CyScenarioBench row: 67.6% without safeguards
3Claude Mythos 5.1not stated61.7%—AnthropicIntroducing Claude Fable 5.2 and Claude Mythos 5.2Retrieved 2026-11-12 · Vendor-reported value. table note: Scores for Fable 5.2, Fable 5.1, and Opus 5.5 show results with safeguards on unless otherwise noted. All scores show each model’s highest-available effort unless otherwise noted.
Source excerpt61.7%Location Table, CyScenarioBench row: 61.7% Mythos 5.1