AutomationBench, no release named
Created by Zapier, 20 Apr 2026 · Higher is better · Website
- OpenAI
- Anthropic
- Reported in a later post or card
Results
| Model | Score | Source |
|---|---|---|
| Claude Fable 5.11 Sep 2026 · Anthropic | 31.4% | Introducing Claude Fable 5.1 and Claude Mythos 5.1Corroborated The same number is printed in 3 other lab documents: 1 2 3Run by Zapier · max effort; with production safeguards; set named in the Claude Fable 5.1 system card, which prints the same figureOur capture |
| Claude Opus 524 Jul 2026 · Anthropic | 26.0% | Introducing Claude Opus 5Corroborated The same number is printed in 1 other lab document: 1Run by Zapier · max effort; set named in the Claude Opus 5 system card, which prints the same figureSource image |
| Claude Opus 524 Jul 2026 · Anthropic | 24% | Claude Opus 5 System CardChecked A person checked this number against its source on 20 Oct 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Run by Zapier · medium effort; another report, not charted |
| GPT-5.6 Sol9 Jul 2026 · OpenAI | 18.1% | GPT-5.6: Frontier intelligence that scales with your ambitionCorroborated The same number is printed in 2 other lab documents: 1 2Run by ZapierOur capture |
| Claude Fable 59 Jun 2026 · Anthropic | 17.4% | Claude Fable 5 and Claude Mythos 5 System CardCorroborated The same number is printed in 2 other lab documents: 1 2Run by Zapier · max effortOur capture |
| Claude Fable 59 Jun 2026 · Anthropic | 17.1% | Introducing Claude Fable 5.1 and Claude Mythos 5.1Corroborated The same number is printed in 1 other lab document: 1Run by Zapier · tasks blocked by safeguards scored zero; set named in the Claude Fable 5.1 system card, which prints 17.05; reported later; another report, not chartedOur capture |
| Claude Opus 4.828 May 2026 · Anthropic | 15.5% | Claude Opus 4.8 System CardCorroborated The same number is printed in 2 other lab documents: 1 2Run by Zapier · max effortOur capture |
| Claude Opus 4.828 May 2026 · Anthropic | 17.0% | Introducing Claude Opus 5Corroborated The same number is printed in 1 other lab document: 1Run by Zapier · max effort; set named in the Claude Opus 5 system card, which prints the same figure; reported later; another report, not chartedSource image |
| GPT-5.6 Terra9 Jul 2026 · OpenAI | 15.2% | GPT-5.6: Frontier intelligence that scales with your ambitionChecked A person checked this number against its source on 26 Oct 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Run by ZapierOur capture |
| GPT-5.6 Luna9 Jul 2026 · OpenAI | 14.9% | GPT-5.6: Frontier intelligence that scales with your ambitionChecked A person checked this number against its source on 26 Oct 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Run by ZapierOur capture |
| Claude Sonnet 530 Jun 2026 · Anthropic | 13.5% | Claude Sonnet 5 System CardChecked A person checked this number against its source on 20 Oct 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Run by Zapier · max effortOur capture |
| GPT-5.523 Apr 2026 · OpenAI | 12.9% | GPT-5.6: Frontier intelligence that scales with your ambitionCorroborated The same number is printed in 1 other lab document: 1Run by Zapier · reported laterOur capture |