Claude models on OSWorld-Verified
Changed by Anthropic on
Said it had changedPrinted a new figure
Anthropic re-ran older models on OSWorld-Verified after fixing a bug in its zoom tool and raising the limit on tokens per turn from 16K to 128K. Claude Opus 4.7 rose from 78.0% to 82.8%, Claude Opus 4.6 from 72.7% to 78.1%, Claude Sonnet 4.6 from 72.5% to 78.4%, and Claude Mythos Preview from 79.6% to 85.4. The Claude Sonnet 5 post later printed 78.5% for Sonnet 4.6. The Claude Opus 4.8 system card says: “we have been underreporting OSWorld performance across our model families”.

Before and after
Claude Opus 4.7


Claude Opus 4.6


Claude Sonnet 4.6


Claude Mythos Preview


- Claude Opus 4.8 System Cardanthropic.com
- Claude Sonnet 5 System Cardanthropic.com
- Claude Fable 5 and Claude Mythos 5 System Cardanthropic.com
- Introducing Claude Opus 4.7anthropic.com
- Introducing Claude Opus 4.8anthropic.com
- Introducing Claude Sonnet 4.6anthropic.com
- Introducing Claude Sonnet 5anthropic.com
- Claude Opus 4.6anthropic.com
- Claude Mythos Preview System Cardanthropic.com