Frontier Log

AnthropicModel

Claude Opus 5

Made by
Anthropic
Released
Announced in
Introducing Claude Opus 5anthropic.com
Event
Claude Opus 5
API record
/api/v1/models/claude-opus-5

Benchmark results

BenchmarkScoreSource check
Humanity's Last ExamNo tools56.3%
CheckedA person checked this number against its source on 16 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
CorroboratedThe same number is printed in 3 other lab documents: 1 2 3
reported later, in Claude Opus 5.5 System Card56.6%
CheckedA person checked this number against its source on 16 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
CorroboratedThe same number is printed in 2 other lab documents: 1 2
Humanity's Last ExamWith tools64.7%
CheckedA person checked this number against its source on 17 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
CorroboratedThe same number is printed in 1 other lab document: 1
reported later, in Introducing Claude Fable 5.1 and Claude Mythos 5.163.6%
CheckedA person checked this number against its source on 17 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
CorroboratedThe same number is printed in 5 other lab documents, the first 3 linked: 1 2 3
SWE-bench Proadaptive thinking, max effort; average of 5 trials · The source doesn't say whether this is the public or the commercial set79.2%
CheckedA person checked this number against its source on 17 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
CorroboratedThe same number is printed in 2 other lab documents: 1 2
BrowseCompcompaction at 200K tokens90.8%
CheckedA person checked this number against its source on 17 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
CorroboratedThe same number is printed in 2 other lab documents: 1 2
ARC-AGI-2max effort; semi-private set; as reported by the ARC Prize Foundation90.4%
CheckedA person checked this number against its source on 17 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
CorroboratedThe same number is printed in 2 other lab documents: 1 2
Terminal-Bench 4.0reported later, in Introducing Claude Fable 5.1 and Claude Mythos 5.152.3%
CheckedA person checked this number against its source on 17 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
CorroboratedThe same number is printed in 4 other lab documents, the first 3 linked: 1 2 3
AutomationBenchmax effort; Zapier leaderboard, private held-out set26.0%
CorroboratedThe same number is printed in 1 other lab document: 1
medium effort; Zapier leaderboard, private held-out set · in Claude Opus 5 System Card24%
CheckedA person checked this number against its source on 20 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
Zapier leaderboard, private held-out set; max effort · reported later, in Introducing Claude Fable 5.1 and Claude Mythos 5.126.9%
CorroboratedThe same number is printed in 3 other lab documents: 1 2 3
OSWorld 2.1Full set, partial score · max effort; mean of 5 runs; September 10, 2026 task files; the system card labels it OSWorld 2.0 · reported later, in Introducing Claude Opus 5.574.0%
CorroboratedThe same number is printed in 1 other lab document: 1
OSWorld 2.0Offline set, partial score · task release not stated70.6%
CheckedA person checked this number against its source on 18 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
partial score; August 2026 task release, not comparable to earlier OSWorld 2.0 scores · reported later, in Introducing Claude Fable 5.1 and Claude Mythos 5.175.4%
CheckedA person checked this number against its source on 19 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
CorroboratedThe same number is printed in 1 other lab document: 1
FrontierCode 1.1Main set · run and scored by Cognition; medium effort, the best of five effort levels; mean of 5 runs53.4%
CorroboratedThe same number is printed in 2 other lab documents: 1 2
run by Cognition in Claude Code · reported later, in Introducing Claude Opus 5.548.0%
CorroboratedThe same number is printed in 1 other lab document: 1
FrontierCode 1.1Extended set · run and scored by Cognition; medium effort, the best of five effort levels; mean of 5 runs63.6%
CorroboratedThe same number is printed in 1 other lab document: 1
DeepSWE v1.1average of 5 trials68.8%
CheckedA person checked this number against its source on 17 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
CorroboratedThe same number is printed in 1 other lab document: 1
ARC-AGI-330.2%
CheckedA person checked this number against its source on 18 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
CorroboratedThe same number is printed in 2 other lab documents: 1 2
Sources

Reported by Anthropic

Events

Stories

All models