OSWorld 2.1
- Anthropic
- Reported in a later post or card
Results
| Model | Score | Source | Source check |
|---|---|---|---|
| Claude Haiku 5.57 Oct 2026 · Anthropic | 72.4% | Introducing Claude Haiku 5.582-task offline subset, no internet access; max effort; mean of 5 attempts | 1 other sourceThe same number is printed in 1 other lab document, linked below. |
| Claude Sonnet 5.528 Sep 2026 · Anthropic | 83.9% | Introducing Claude Haiku 5.582-task offline subset, no internet access; max effort; mean of 5 attempts; reported later | 1 other sourceThe same number is printed in 1 other lab document, linked below. |
| Claude Opus 5.522 Sep 2026 · Anthropic | 87.2% | Claude Haiku 5.5 System Card82-task offline subset, no internet access; max effort; mean of 5 attempts; reported later | Source checkedA person checked this number against its source on 20 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced. |
| Claude Haiku 4.515 Oct 2025 · Anthropic | 15.7% | Introducing Claude Haiku 5.582-task offline subset, no internet access; fixed thinking budget, no server-side context compaction; mean of 5 attempts; reported later | 1 other sourceThe same number is printed in 1 other lab document, linked below. |
Benchmark
github.comHigher is better
XLANG LabIntroduced 16 Sep 2026