Frontier Log

Benchmark · InactiveSuperseded by OSWorld 2.1

OSWorld 2.0, release not stated

Created by XLANG Lab, 28 Jun 2026 · Higher is better · Website

010203019.4%Qwen3.8-Max010203019.4%Qwen3.8-Max

Settings and run setups

Task setScoringProviders
Not statedNot statedOpenAIAnthropic
Google lists GPT-5.6 Sol’s 62.6% under “OSWorld-2.0, Partial score, batch tool enabled”Google lists GPT-5.6 Terra’s 50.2% under “OSWorld-2.0, Partial score, batch tool enabled”
Not statedPartial scoreAlibaba
Not statedStrict pass rateAlibaba
Anthropic's Sep 10 filesPartial scoreAnthropic
Anthropic's Sep 10 filesStrict pass rateAnthropic

Download image

Results

ModelScoreSource
Qwen3.8-Max3 Aug 202619.4%Qwen3.8-Max: A New Bar for Coding and CoworkChecked A person checked this number against its source on 10 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.binary score: share of tasks with the full task rewardOur capture

All benchmarks