Terminal-Bench 4.1
Created by Stanford University and Laude Institute, 9 Nov 2026 · Higher is better · Website
Versions
| Version | Released | Status | Models |
|---|---|---|---|
| Terminal-Bench 1.0 | 19 May 2025 | Inactive | 17 |
| Terminal-Bench 2.0 | 7 Nov 2025 | Inactive | 46 |
| Terminal-Bench 2.1 | 6 May 2026 | Active | 48 |
| Terminal-Bench 4.0 | 28 Aug 2026 | Active | 30 |
| Terminal-Bench 4.1 | 9 Nov 2026 | Active | 43 |
Results
Show
- OpenAI
- Anthropic
- Other labs
- Reported in a later post or card, or on the creator’s leaderboard
- OpenAI
- Anthropic
- Other labs
- Reported in a later post or card, or on the creator’s leaderboard
| Model | Harness and effort | Score | Source |
|---|---|---|---|
| Claude Fable 5.29 Nov 2026 | Claude Codemax effort | 65.8% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| Claude Opus 5.522 Sep 2026 | Claude Codemax effort | 65.8% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| Gemini 4 Carbon28 Oct 2026 | Antigravity CLIhigh effort | 64.5% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| Claude Sonnet 5.528 Sep 2026 | Claude Codemax effort | 63.9% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| GPT-6.2 Astra17 Nov 2026 | Codexmax effort | 62.1% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| GPT-6.2 Sol17 Nov 2026 | Codexmax effort | 61.5% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| GPT-6.1 Sol29 Sep 2026 | Codexmax effort | 60.9% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| GPT-6 Astra3 Sep 2026 | Codexmax effort | 60.3% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| Kimi K3.1 Pro24 Oct 2026 | Claude Codemax effort | 59.7% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| Claude Fable 5.11 Sep 2026 | Claude Codexhigh effort | 57.6% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| Gemini 4 Hydrogen12 Nov 2026 | mini-SWE-agenthigh effort level | 57.0% | Introducing Gemini 4 HydrogenChecked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.averaged over 5 attempts per task · cheating-adjusted accuracySource image |
| Gemini 4 Hydrogen12 Nov 2026 | Antigravity CLIhigh effort | 56.4% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Stanford University and Laude Institute’s leaderboard, 18 Nov 2026 · another reportOur capture |
| Gemini 4 Argon30 Sep 2026 | Antigravity CLIhigh effort | 55.5% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| GPT-6.1 Terra26 Oct 2026 | Codexmax effort | 53.3% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| Claude Opus 524 Jul 2026 | Claude Codexhigh effort | 53.3% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| GPT-6 Sol22 Sep 2026 | Codexmax effort | 50.3% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| Muse Wonder12 Oct 2026 | Muse Codexhigh effort | 47.0% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| Claude Fable 59 Jun 2026 | Claude Codemax effort | 44.8% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| GLM-5.314 Aug 2026 | Claude Codemax effort | 41.2% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| Claude Haiku 5.57 Oct 2026 | Claude Codemax effort | 40.0% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| DeepSeek-V4.1-Flash-101717 Oct 2026 | Claude Codemax effort | 38.5% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| GPT-5.6 Sol9 Jul 2026 | Codexmax effort | 38.5% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| Hy44 Nov 2026 | Claude Codemax effort | 37.9% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| GLM-5.3-Flash26 Aug 2026 | Claude Codemax effort | 37.0% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| Muse Ember9 Nov 2026 | Muse Codexhigh effort | 30.6% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| Mistral Large 46 Oct 2026 | Claude Codemax effort | 27.6% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| Qwen3.8-Max-09022 Sep 2026 | Claude Codemax effort | 27.0% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| Claude Opus 4.828 May 2026 | Claude Codemax effort | 23.6% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| Kimi K316 Jul 2026 | Claude Codemax effort | 23.0% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| GPT-5.6 Terra9 Jul 2026 | Codexmax effort | 21.5% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| Hy4 preview28 Aug 2026 | Claude Codemax effort | 19.1% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| Gemini 3.8 Flash2 Sep 2026 | Harness not specifiedEffort not specified | 18.2% | Introducing Gemini 4 HydrogenCorroborated The same number is printed in 1 other document: 1reported later |
| Gemini 3.8 Flash2 Sep 2026 | mini-SWE-agenthigh effort | 18.2% | Terminal-Bench 4.1Corroborated The same number is printed in 1 other document: 1Stanford University and Laude Institute’s leaderboard, 18 Nov 2026 · another reportOur capture |
| GPT-5.6 Luna9 Jul 2026 | Codexmax effort | 17.6% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| GPT-6 Luna22 Sep 2026 | Codexmax effort | 15.2% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| Muse Spark 1.32 Sep 2026 | Muse Codexhigh effort | 14.8% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| Inkling 2 Small5 Nov 2026 | mini-SWE-agentxhigh effort | 13.0% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| Gemini 3.7 Flash13 Aug 2026 | mini-SWE-agenthigh effort | 12.4% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| Claude Sonnet 530 Jun 2026 | Claude Codemax effort | 12.1% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| MiniMax M31 Jun 2026 | mini-SWE-agenteffort none | 7.6% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| DeepSeek-V4-Pro-081313 Aug 2026 | Claude Codemax effort | 6.7% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| Gemini 3.1 Pro19 Feb 2026 | Antigravity CLIhigh effort | 2.7% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| GPT-5.4 mini17 Mar 2026 | Codexxhigh effort | 1.8% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| Nemotron 3.5 Super VL 120B-A12B15 Oct 2026 | mini-SWE-agenteffort none | 0.3% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |
| Inkling15 Jul 2026 | mini-SWE-agenteffort none | 0.0% | Terminal-Bench 4.1Checked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Our capture |