Frontier Log

Benchmark · InactiveSuperseded by OSWorld 2.1

OSWorld 2.0 (v2026.08.08)

Created by XLANG Lab, 8 Aug 2026 · Higher is better · Website

020406080Jul 2026Oct 202677.9%Fable 5.175.4%Opus 5020406080Jul 2026Oct 202677.9%Fable 5.175.4%Opus 5

Results

ModelScoreSource
Claude Fable 5.11 Sep 2026 · Anthropic77.9%Introducing Claude Fable 5.1 and Claude Mythos 5.1Checked A person checked this number against its source on 18 Oct 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.tasks where safeguards intervened scored zeroOur capture
Claude Opus 524 Jul 2026 · Anthropic75.4%Introducing Claude Fable 5.1 and Claude Mythos 5.1Checked A person checked this number against its source on 19 Oct 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.Corroborated The same number is printed in 1 other lab document: 1reported laterOur capture

All benchmarks