Chartography
Created by Surge AI, 16 Jul 2026 · Higher is better · Website
- Other labs
- Reported in a later post or card
Settings and run setups
| Tools | Providers |
|---|---|
| No tools | |
| With tools | |
| Not stated |
Benchmark creator (Surge AI)’s default · Gemini 3.5 Flash judge · Paper · README · task.py
Results
| Model | Score | Source |
|---|---|---|
| DeepSeek-V4-Flash-Vision-Exp21 Aug 2026 | 64.3% | DeepSeek-V4-Flash-Vision-Exp Release: Multimodal API Now LiveChecked A person checked this number against its source on 30 Oct 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.in the post's 'Multimodal Agent Evaluation' blockSource image |
| Qwen4-Max16 Nov 2026 | 54.2% | Qwen4-Max: Your New Teammate Has Arrivedmin_pixels set to 4096×32×32Source image |
| Qwen3.8-Max-09022 Sep 2026 | 42.0% | Qwen4-Max: Your New Teammate Has Arrivedmin_pixels set to 4096×32×32 · reported laterSource image |