FrontierSWE v2, Claude Sonnet 5.5: Run by Proximal · Proximal's agent harness · max reasoning effort · mean of 5 trials per task · 20-hour budget
DeepSWE v1.1, Claude Sonnet 5.5: average of 5 trials
Chartography, With tools, Claude Sonnet 5.5: max effort · adaptive thinking · average of 5 runs · container and image-cropping tool · Gemini 3.5 Flash grader
Agents' Last Exam v1.1, Score, all tasks (122), Gemini 4 Hydrogen: Antigravity-CLI (agy) version 1.4.8 harness · highest thinking · 5-hour window · October 17, 2026 task files · safety filters on