Frontier Log

Benchmark · Active

Chartography

Created by Surge AI, 16 Jul 2026 · Higher is better · Website

020406080Oct 202664.3%DeepSeek-V4-Flash-Vision-Exp54.2%Qwen4-Max42.0%Qwen3.8-Max-0902020406080Oct 202664.3%DeepSeek-V4-Flash-Vision-Exp54.2%Qwen4-Max42.0%Qwen3.8-Max-0902

Settings and run setups

ToolsProviders
DefaultNo toolsAnthropicGoogleThinking Machines
With toolsAnthropicDeepSeekMoonshot AIZ.aiThinking Machines
Not statedDeepSeekAlibaba

DefaultBenchmark creator (Surge AI)’s default · Gemini 3.5 Flash judge · Paper · README · task.py

Download image

Results

ModelScoreSource
DeepSeek-V4-Flash-Vision-Exp21 Aug 202664.3%DeepSeek-V4-Flash-Vision-Exp Release: Multimodal API Now LiveChecked A person checked this number against its source on 30 Oct 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.in the post's 'Multimodal Agent Evaluation' blockSource image
Qwen4-Max16 Nov 202654.2%Qwen4-Max: Your New Teammate Has Arrivedmin_pixels set to 4096×32×32Source image
Qwen3.8-Max-09022 Sep 202642.0%Qwen4-Max: Your New Teammate Has Arrivedmin_pixels set to 4096×32×32 · reported laterSource image

All benchmarks