Frontier Log

DeepSeekModel

DeepSeek-V4-Pro

Made by
DeepSeek
Released
Announced in
DeepSeek V4 Preview Releaseapi-docs.deepseek.com
Event
DeepSeek V4 Preview
API record
/api/v1/models/deepseek-v4-pro

Benchmark results

BenchmarkScoreSource check
Humanity's Last ExamNo tools · max reasoning effort; full or text-only set not stated37.7%
CorroboratedThe same number is printed in 1 other lab document: 1
Humanity's Last ExamWith tools · max reasoning effort48.2%
CorroboratedThe same number is printed in 1 other lab document: 1
SWE-bench Verifiedmax reasoning effort80.6%
CheckedA person checked this number against its source on 17 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
CorroboratedThe same number is printed in 2 other lab documents: 1 2
SWE-bench Promax reasoning effort · The source doesn't say whether this is the public or the commercial set55.4%
CheckedA person checked this number against its source on 17 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
CorroboratedThe same number is printed in 3 other lab documents: 1 2 3
GPQA Diamondmax reasoning effort90.1%
CheckedA person checked this number against its source on 17 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
CorroboratedThe same number is printed in 1 other lab document: 1
BrowseCompmax reasoning effort83.4%
CheckedA person checked this number against its source on 17 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
CorroboratedThe same number is printed in 2 other lab documents: 1 2
Terminal-Bench 2.0max reasoning effort67.9%
CheckedA person checked this number against its source on 18 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
CorroboratedThe same number is printed in 1 other lab document: 1
AutomationBenchpublic set · reported later, in DeepSeek-V4-Pro GA Release12.8%
CheckedA person checked this number against its source on 20 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
MMLU-Promax reasoning effort87.5%
CheckedA person checked this number against its source on 18 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
LiveCodeBenchmax reasoning effort; problem window not stated93.5%
CheckedA person checked this number against its source on 18 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
Sources

Reported by DeepSeek

Events

Stories

All models