Frontier Log

Benchmark · Active

Terminal-Bench 4.1

Created by Stanford University and Laude Institute, 9 Nov 2026 · Higher is better · Website

Versions

VersionReleasedStatusModels
Terminal-Bench 1.019 May 2025Inactive17
Terminal-Bench 2.07 Nov 2025Inactive46
Terminal-Bench 2.16 May 2026Active48
Terminal-Bench 4.028 Aug 2026Active30
Terminal-Bench 4.19 Nov 2026Active43

Results

Show
020406080Apr 2026Jul 2026Oct 2026Jan 202765.8%Opus 5.562.1%GPT-6.2 Astra53.3%Opus 544.8%Fable 523.6%Opus 4.82.7%Gemini 3.1 Pro020406080Apr 2026Jul 2026Oct 2026Jan 202765.8%Opus 5.562.1%GPT-6.2 Astra53.3%Opus 544.8%Fable 523.6%Opus 4.8
  • OpenAI
  • Anthropic
  • Google
  • Other labs
  • Reported in a later post or card, or on the creator’s leaderboard
ModelHarness and effortScoreSource
Claude Fable 5.29 Nov 2026Claude Codemax effort65.8%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
Claude Opus 5.522 Sep 2026Claude Codemax effort65.8%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
Gemini 4 Carbon28 Oct 2026Antigravity CLIhigh effort64.5%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
Claude Sonnet 5.528 Sep 2026Claude Codemax effort63.9%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
GPT-6.2 Astra17 Nov 2026Codexmax effort62.1%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
GPT-6.2 Sol17 Nov 2026Codexmax effort61.5%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
GPT-6.1 Sol29 Sep 2026Codexmax effort60.9%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
GPT-6 Astra3 Sep 2026Codexmax effort60.3%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
Kimi K3.1 Pro24 Oct 2026Claude Codemax effort59.7%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
Claude Fable 5.11 Sep 2026Claude Codexhigh effort57.6%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
Gemini 4 Hydrogen12 Nov 2026mini-SWE-agenthigh effort level57.0%Introducing Gemini 4 HydrogenChecked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.averaged over 5 attempts per task · cheating-adjusted accuracySource image
Gemini 4 Hydrogen12 Nov 2026Antigravity CLIhigh effort56.4%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Stanford University and Laude Institute’s leaderboard, 18 Nov 2026 · another reportOur capture
Gemini 4 Argon30 Sep 2026Antigravity CLIhigh effort55.5%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
GPT-6.1 Terra26 Oct 2026Codexmax effort53.3%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
Claude Opus 524 Jul 2026Claude Codexhigh effort53.3%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
GPT-6 Sol22 Sep 2026Codexmax effort50.3%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
Muse Wonder12 Oct 2026Muse Codexhigh effort47.0%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
Claude Fable 59 Jun 2026Claude Codemax effort44.8%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
GLM-5.314 Aug 2026Claude Codemax effort41.2%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
Claude Haiku 5.57 Oct 2026Claude Codemax effort40.0%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
DeepSeek-V4.1-Flash-101717 Oct 2026Claude Codemax effort38.5%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
GPT-5.6 Sol9 Jul 2026Codexmax effort38.5%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
Hy44 Nov 2026Claude Codemax effort37.9%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
GLM-5.3-Flash26 Aug 2026Claude Codemax effort37.0%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
Muse Ember9 Nov 2026Muse Codexhigh effort30.6%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
Mistral Large 46 Oct 2026Claude Codemax effort27.6%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
Qwen3.8-Max-09022 Sep 2026Claude Codemax effort27.0%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
Claude Opus 4.828 May 2026Claude Codemax effort23.6%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
Kimi K316 Jul 2026Claude Codemax effort23.0%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
GPT-5.6 Terra9 Jul 2026Codexmax effort21.5%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
Hy4 preview28 Aug 2026Claude Codemax effort19.1%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
Gemini 3.8 Flash2 Sep 2026Harness not specifiedEffort not specified18.2%Introducing Gemini 4 HydrogenCorroborated The same number is printed in 1 other document: 1reported later
Gemini 3.8 Flash2 Sep 2026mini-SWE-agenthigh effort18.2%Terminal-Bench 4.1Corroborated The same number is printed in 1 other document: 1Stanford University and Laude Institute’s leaderboard, 18 Nov 2026 · another reportOur capture
GPT-5.6 Luna9 Jul 2026Codexmax effort17.6%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
GPT-6 Luna22 Sep 2026Codexmax effort15.2%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
Muse Spark 1.32 Sep 2026Muse Codexhigh effort14.8%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
Inkling 2 Small5 Nov 2026mini-SWE-agentxhigh effort13.0%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
Gemini 3.7 Flash13 Aug 2026mini-SWE-agenthigh effort12.4%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
Claude Sonnet 530 Jun 2026Claude Codemax effort12.1%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
MiniMax M31 Jun 2026mini-SWE-agenteffort none7.6%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
DeepSeek-V4-Pro-081313 Aug 2026Claude Codemax effort6.7%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
Gemini 3.1 Pro19 Feb 2026Antigravity CLIhigh effort2.7%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
GPT-5.4 mini17 Mar 2026Codexxhigh effort1.8%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
Nemotron 3.5 Super VL 120B-A12B15 Oct 2026mini-SWE-agenteffort none0.3%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture
Inkling15 Jul 2026mini-SWE-agenteffort none0.0%Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture

All benchmarks