Frontier Log

Benchmark · Active

GraphWalks

Created by OpenAI, 12 Apr 2025 · Higher is better · Website

020406080100Jul 2024Oct 2024Jan 2025Apr 2025Jul 2025Oct 2025Jan 2026Apr 202689.8%GPT-5.471.5%GPT-5.4 mini89.0%GPT-5.273.3%GPT-572.9%OpenAI o358.3%o3-mini35.4%GPT-4o020406080100Jul 2024Jan 2025Jul 2025Jan 202689.8%GPT-5.471.5%GPT-5.4 mini73.3%GPT-572.6%GPT-4.558.3%o3-mini

Settings and run setups

DomainTask setProviders
BFSUp to 128KOpenAIGoogle
BFS256K + 1M problemsOpenAIAnthropicGoogle
BFS256K problems onlyOpenAIAnthropic
BFS1M problems onlyOpenAIAnthropic
ParentsUp to 128KOpenAI
Parents256K + 1M problemsOpenAIAnthropic
Parents256K problems onlyOpenAIAnthropic
Parents1M problems onlyOpenAIAnthropic

Download image

Results

ModelScoreSource
GPT-5.45 Mar 202689.8%Introducing GPT-5.4Corroborated The same number is printed in 1 other lab document: 1Our capture
GPT-5.211 Dec 202589.0%Introducing GPT-5.2Corroborated The same number is printed in 1 other lab document: 1ThinkingRun on the set as first published, before the creator reworded the prompts and corrected 24 parents answers on Feb 27, 2026Our capture
GPT-57 Aug 202573.3%Introducing GPT-5 for developersChecked A person checked this number against its source on 11 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.high reasoning effort · reported laterRun on the set as first published, before the creator reworded the prompts and corrected 24 parents answers on Feb 27, 2026Our capture
OpenAI o316 Apr 202572.9%Introducing GPT-5 for developersChecked A person checked this number against its source on 11 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.high reasoning effort · reported laterRun on the set as first published, before the creator reworded the prompts and corrected 24 parents answers on Feb 27, 2026Our capture
GPT-4.527 Feb 202572.6%Introducing GPT-4.1 in the APIChecked A person checked this number against its source on 11 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.reported laterRun on the set as first published, before the creator reworded the prompts and corrected 24 parents answers on Feb 27, 2026Our capture
GPT-5.4 mini17 Mar 202671.5%Introducing GPT-5.4 mini and nanoChecked A person checked this number against its source on 11 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.xhigh effortOur capture
GPT-5.112 Nov 202571.5%Introducing GPT-5.2Checked A person checked this number against its source on 11 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Thinking · reported laterRun on the set as first published, before the creator reworded the prompts and corrected 24 parents answers on Feb 27, 2026Our capture
GPT-5 mini7 Aug 202564.3%Introducing GPT-5 for developersCorroborated The same number is printed in 1 other lab document: 1high reasoning effort · reported laterRun on the set as first published, before the creator reworded the prompts and corrected 24 parents answers on Feb 27, 2026Our capture
GPT-4.1 mini14 Apr 202560.5%Introducing GPT-4.1 in the APICorroborated The same number is printed in 1 other lab document: 1Run on the set as first published, before the creator reworded the prompts and corrected 24 parents answers on Feb 27, 2026Our capture
o3-mini31 Jan 202558.3%Introducing GPT-4.1 in the APIChecked A person checked this number against its source on 11 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.high reasoning effort · reported laterRun on the set as first published, before the creator reworded the prompts and corrected 24 parents answers on Feb 27, 2026Our capture
GPT-4.114 Apr 202558.0%Introducing GPT-4.1 in the APICorroborated The same number is printed in 1 other lab document: 1Run on the set as first published, before the creator reworded the prompts and corrected 24 parents answers on Feb 27, 2026Our capture
o4-mini16 Apr 202551.1%Introducing GPT-5 for developersChecked A person checked this number against its source on 11 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.high reasoning effort · reported laterRun on the set as first published, before the creator reworded the prompts and corrected 24 parents answers on Feb 27, 2026Our capture
OpenAI o117 Dec 202450.9%Introducing GPT-4.1 in the APIChecked A person checked this number against its source on 11 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.high reasoning effort · reported laterRun on the set as first published, before the creator reworded the prompts and corrected 24 parents answers on Feb 27, 2026Our capture
GPT-5.4 nano17 Mar 202650.8%Introducing GPT-5.4 mini and nanoChecked A person checked this number against its source on 11 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.xhigh effortOur capture
GPT-5 nano7 Aug 202543.8%Introducing GPT-5 for developersChecked A person checked this number against its source on 11 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.high reasoning effort · reported laterRun on the set as first published, before the creator reworded the prompts and corrected 24 parents answers on Feb 27, 2026Our capture
GPT-4o13 May 202435.4%Introducing GPT-4.1 in the APIChecked A person checked this number against its source on 11 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.2024-11-20 snapshot · reported laterRun on the set as first published, before the creator reworded the prompts and corrected 24 parents answers on Feb 27, 2026Our capture
GPT-4o mini18 Jul 202412.6%Introducing GPT-4.1 in the APIChecked A person checked this number against its source on 11 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.reported laterRun on the set as first published, before the creator reworded the prompts and corrected 24 parents answers on Feb 27, 2026Our capture
GPT-4.1 nano14 Apr 20259.4%Introducing GPT-4.1 in the APICorroborated The same number is printed in 1 other lab document: 1Run on the set as first published, before the creator reworded the prompts and corrected 24 parents answers on Feb 27, 2026Our capture

All benchmarks