Frontier Log

Benchmark · Active

OSWorld 2.1

020406080100Jul 2026Oct 202657.0%Sonnet 574.0%Opus 580.7%Fable 5.180.1%Sonnet 5.5020406080100Jul 2026Oct 202657.0%Sonnet 574.0%Opus 580.7%Fable 5.180.1%Sonnet 5.5

Results

ModelScoreSourceSource check
Claude Sonnet 5.528 Sep 2026 · Anthropic80.1%Introducing Claude Sonnet 5.5max effort; mean of 5 runs; September 10, 2026 task files
1 other sourceThe same number is printed in 1 other lab document, linked below.
1
Claude Opus 5.522 Sep 2026 · Anthropic81.8%Introducing Claude Opus 5.5max effort; mean of 5 runs; September 10, 2026 task files; the system card labels it OSWorld 2.0
3 other sourcesThe same number is printed in 3 other lab documents, linked below.
1 2 3
Claude Fable 5.11 Sep 2026 · Anthropic80.7%Introducing Claude Opus 5.5max effort; mean of 5 runs; September 10, 2026 task files; the system card labels it OSWorld 2.0; reported later
1 other sourceThe same number is printed in 1 other lab document, linked below.
1
Claude Opus 524 Jul 2026 · Anthropic74.0%Introducing Claude Opus 5.5max effort; mean of 5 runs; September 10, 2026 task files; the system card labels it OSWorld 2.0; reported later
1 other sourceThe same number is printed in 1 other lab document, linked below.
1
Claude Sonnet 530 Jun 2026 · Anthropic57.0%Introducing Claude Sonnet 5.5max effort; mean of 5 runs; September 10, 2026 task files; reported later
1 other sourceThe same number is printed in 1 other lab document, linked below.
1

Benchmark

github.comHigher is better

XLANG LabIntroduced 16 Sep 2026

All benchmarks