76.5%Checked A person checked this number against its source on 7 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.
SWE-bench ProSet not stated · v1.0; OpenCode harness; maximum effort
61.42%Checked A person checked this number against its source on 7 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.
85.2%Checked A person checked this number against its source on 7 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.
36.4%Corroborated The same number is printed in 1 other lab document: 1
DeepSWE v1.1Terminus 2 harness and maximum effort per the model card
44.3%Corroborated The same number is printed in 1 other lab document: 1
AIME 2024No tools · maximum effort; tools not stated
97.1%Checked A person checked this number against its source on 7 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.
AIME 2025No tools · maximum effort; tools not stated
98.3%Checked A person checked this number against its source on 7 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.
84.2%Checked A person checked this number against its source on 7 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.
MCP AtlasSet not stated · OpenCode harness; maximum effort
71.67%Checked A person checked this number against its source on 7 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.
79.2%Checked A person checked this number against its source on 7 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.
