Frontier Log

AnthropicModel

Claude Sonnet 4

Made by
Anthropic
Released
Announced in
Introducing Claude 4anthropic.com
Event
Claude 4 (Opus 4 and Sonnet 4)
API record
/api/v1/models/claude-sonnet-4

Benchmark results

BenchmarkScoreSource check
SWE-bench Verifiedno extended thinking; bash and file-editing tools; full 500 problems72.7%
CheckedA person checked this number against its source on 17 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
CorroboratedThe same number is printed in 3 other lab documents: 1 2 3
parallel test-time compute · parallel test-time compute80.2%
CheckedA person checked this number against its source on 17 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
CorroboratedThe same number is printed in 2 other lab documents: 1 2
GPQA Diamondextended thinking up to 64K tokens75.4%
CheckedA person checked this number against its source on 17 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
CorroboratedThe same number is printed in 1 other lab document: 1
no extended thinking70.0%
CheckedA person checked this number against its source on 17 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
CorroboratedThe same number is printed in 1 other lab document: 1
parallel test-time compute: best of several samples by an internal scoring model · parallel test-time compute83.8%
CheckedA person checked this number against its source on 17 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
Sources

Reported by Anthropic

Events

Stories

All models