Frontier Log

AnthropicModel

Claude 3.5 Sonnet

Made by
Anthropic
Released
Announced in
Introducing Claude 3.5 Sonnetanthropic.com
Event
Claude 3.5 Sonnet
API record
/api/v1/models/claude-3-5-sonnet

Benchmark results

BenchmarkScoreSource check
GPQA Diamond0-shot chain of thought59.4%
CheckedA person checked this number against its source on 17 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
5-shot chain of thought, majority vote over 32 samples · parallel test-time compute67.2%
CheckedA person checked this number against its source on 17 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
Sources

Reported by Anthropic

Events

Stories

All models