Frontier Log

GoogleModel

Gemini 2.5 Pro

Made by
Google
Released
Announced in
Gemini 2.5: Our most intelligent AI modelblog.google
Event
Gemini 2.5 Pro
API record
/api/v1/models/gemini-2-5-pro

Benchmark results

BenchmarkScoreSource check
Humanity's Last ExamNo tools · pass@118.8%
CheckedA person checked this number against its source on 17 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
reported later, in Start building with Gemini 321.6%
CheckedA person checked this number against its source on 17 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
SWE-bench Verifiedsingle attempt · reported later, in Start building with Gemini 359.6%
CheckedA person checked this number against its source on 17 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
multiple attempts: Google's scaffold draws several trajectories and the model picks one · parallel test-time compute · in Gemini 2.5: Our most intelligent AI model63.8%
CheckedA person checked this number against its source on 17 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
GPQA Diamondpass@184.0%
CheckedA person checked this number against its source on 17 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
reported later, in Start building with Gemini 386.4%
CheckedA person checked this number against its source on 17 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
CorroboratedThe same number is printed in 2 other lab documents: 1 2
ARC-AGI-2ARC Prize Verified · reported later, in Start building with Gemini 34.9%
CheckedA person checked this number against its source on 17 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
AIME 2024No tools · pass@1, averaged over multiple trials92.0%
CheckedA person checked this number against its source on 18 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
CorroboratedThe same number is printed in 1 other lab document: 1
AIME 2025No tools · pass@1, averaged over multiple trials86.7%
CheckedA person checked this number against its source on 18 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced.
CorroboratedThe same number is printed in 1 other lab document: 1
reported later, in Start building with Gemini 388.0%
CorroboratedThe same number is printed in 4 other lab documents, the first 3 linked: 1 2 3
Sources

Reported by Google

Events

Stories

All models