AutomationBench 1.0.6
Created by Zapier, 31 Jul 2026 · Higher is better · Website
- Other labs
- Reported in a later post or card
Results
| Model | Score | Source |
|---|---|---|
| Kimi K3.1 Pro24 Oct 2026 · Moonshot AI | 73.3% | Kimi K3.1 Pro Tech Blog: Advancing Open IntelligenceChecked A person checked this number against its source on 8 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Run by Artificial Analysis · max reasoning effortOur capture |
| Mistral Large 46 Oct 2026 · Mistral | 59.9% | Introducing Mistral Large 4Checked A person checked this number against its source on 8 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Run by Artificial AnalysisSource image |
| Inkling 2 Small5 Nov 2026 · Thinking Machines | 45.6% | Inkling 2 Small Model CardChecked A person checked this number against its source on 8 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Run by Artificial Analysis · v1.0.6 |
| Mistral Medium 3.522 May 2026 · Mistral | 6.3% | Introducing Mistral Large 4Checked A person checked this number against its source on 8 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Run by Artificial Analysis · reported laterSource image |
