SEC-bench Pro 260505
Created by University of Illinois Urbana-Champaign, 5 May 2026 · Higher is better · Website
- Other labs
- Reported in a later post or card
Results
| Model | Score | Source | Source check |
|---|---|---|---|
| Gemini 4 Carbon28 Oct 2026 · Google | 88.2% | Gemini 4 Carbon: our next frontier model183-task JavaScript engine split (May 2026); pass@1, mean of 3 attempts; Antigravity harness; LLM judge for crashes in both buildsSource image | CorroboratedThe same number is printed in 1 other lab document: 1 |
| Gemini 4 Argon30 Sep 2026 · Google | 83.4% | Gemini 4 Carbon: our next frontier model183-task JavaScript engine split (May 2026); pass@1, mean of 3 attempts; Antigravity harness; LLM judge for crashes in both builds; reported laterSource image | CorroboratedThe same number is printed in 1 other lab document: 1 |
| DeepSeek-V4.1-Flash10 Sep 2026 · DeepSeek | 62.8% | DeepSeek-V4.1-Flash: Smarter, Faster, More EfficientClaude Code harness; max reasoning effortSource image | |
| DeepSeek-V4-Pro-081313 Aug 2026 · DeepSeek | 56.4% | DeepSeek-V4.1-Flash: Smarter, Faster, More Efficientmax reasoning effort; reported laterSource image |
