Frontier Log

Benchmark · Active

OSWorld 2.1

Created by XLANG Lab, 16 Sep 2026 · Higher is better · Website

020406080100Oct 202680.9%GPT-6 Astra74.2%GPT-6.1 Terra78.0%GPT-6.1 Sol020406080100Oct 202680.9%GPT-6 Astra74.2%GPT-6.1 Terra78.0%GPT-6.1 Sol

Settings and run setups

Task setScoringHarnessProviders
Full set (108 tasks)Partial scoreNot statedAnthropicTencent
Full set (108 tasks)Partial scoreCommon internal frameworkMeta
Full set (108 tasks)Strict pass rateNot statedAnthropic
Full set (108 tasks)Strict pass rateCommon internal frameworkMeta
Offline set (82 tasks)Partial scoreNot statedAnthropic
Offline set (82 tasks)Partial scoreGemini CUA harnessGoogle
Offline set (82 tasks)Strict pass rateNot statedAnthropic
Offline set (82 tasks)Not statedNot statedOpenAI
OpenAI compares GPT-6.1 Terra with Claude Sonnet 5.5’s 83.9%, which Anthropic lists under “8.9.3 OSWorld 2.1 offline subset”
Not statedNot statedKimi Agent harnessMoonshot AI
Tencent lists Kimi K3.1 Pro’s 79.6 under “OSWorld 2.1 (Full, partial score)”

Download image

Results

ModelScoreSource
GPT-6 Astra3 Sep 202680.9%Introducing GPT-6.1 TerraCorroborated The same number is printed in 1 other lab document: 1max effort · reported laterOur capture
GPT-6 Astra3 Sep 202663.3%Introducing GPT-6.1 TerraChecked A person checked this number against its source on 8 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.low effort · reported later · another report, not chartedOur capture
GPT-6 Astra3 Sep 202675.4%Introducing GPT-6.1 TerraChecked A person checked this number against its source on 8 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.medium effort · reported later · another report, not chartedOur capture
GPT-6 Astra3 Sep 202678.3%Introducing GPT-6.1 TerraChecked A person checked this number against its source on 8 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.high effort · reported later · another report, not chartedOur capture
GPT-6 Astra3 Sep 202679.0%Introducing GPT-6.1 TerraChecked A person checked this number against its source on 8 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.xhigh effort · reported later · another report, not chartedOur capture
GPT-6.1 Sol29 Sep 202678.0%Introducing GPT-6.1 TerraChecked A person checked this number against its source on 8 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.max effort · reported laterOur capture
GPT-6.1 Sol29 Sep 202660.9%Introducing GPT-6.1 TerraChecked A person checked this number against its source on 8 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.low effort · reported later · another report, not chartedOur capture
GPT-6.1 Sol29 Sep 202673.5%Introducing GPT-6.1 TerraChecked A person checked this number against its source on 8 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.medium effort · reported later · another report, not chartedOur capture
GPT-6.1 Sol29 Sep 202675.5%Introducing GPT-6.1 TerraChecked A person checked this number against its source on 8 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.high effort · reported later · another report, not chartedOur capture
GPT-6.1 Sol29 Sep 202675.9%Introducing GPT-6.1 TerraChecked A person checked this number against its source on 8 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.xhigh effort · reported later · another report, not chartedOur capture
GPT-6.1 Terra26 Oct 202674.2%Introducing GPT-6.1 TerraChecked A person checked this number against its source on 8 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.max effortOur capture
Compared with Claude Sonnet 5.5’s 83.9%, which Anthropic lists under “8.9.3 OSWorld 2.1 offline subset”
GPT-6.1 Terra26 Oct 202653.8%Introducing GPT-6.1 TerraChecked A person checked this number against its source on 8 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.low effort · another report, not chartedOur capture
GPT-6.1 Terra26 Oct 202666.7%Introducing GPT-6.1 TerraChecked A person checked this number against its source on 8 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.medium effort · another report, not chartedOur capture
GPT-6.1 Terra26 Oct 202668.7%Introducing GPT-6.1 TerraChecked A person checked this number against its source on 8 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.high effort · another report, not chartedOur capture
GPT-6.1 Terra26 Oct 202671.3%Introducing GPT-6.1 TerraChecked A person checked this number against its source on 8 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.xhigh effort · another report, not chartedOur capture

All benchmarks