ExploitGym
Created by Berkeley RDI, 11 May 2026 · Higher is better · Website
Settings
| Task set | Scoring | Mitigations | Reported by |
|---|---|---|---|
| ExploitGym 1.0 (869 tasks) | Score | Mitigations off | |
| ExploitGym 1.0 (869 tasks) | Score | Mitigations on | |
| ExploitGym 1.0 (869 tasks) | Score | Not specified | |
| ExploitGym 1.0 (869 tasks) | Successful exploits | Mitigations off | |
| ExploitGym 1.0 (869 tasks) | Successful exploits | Not specified |
Bold: Benchmark default based on Paper and Leaderboard · Download image
Results
Show
- OpenAI
- Reported in a later post or card
- OpenAI
- Reported in a later post or card
| Model | Harness and effort | Score | Source |
|---|---|---|---|
| Gemini 4 Carbon28 Oct 2026 | AntigravityEffort not specified | 54.8% | Gemini 4 Carbon: our next frontier modelChecked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.single attempt per task · no internet access · 10h time cap per task · evaluated without guardrails · mitigations off, per the model evaluation |
| Gemini 4 Carbon28 Oct 2026 | AntigravityEffort not specified | 53.5% | Gemini 4 Carbon: our next frontier modelChecked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.single attempt per task · no internet access · 6h time cap per task · evaluated without guardrails · mitigations off, per the model evaluation · another reportSource image |
| GPT-6-Cyber5 Nov 2026 | Harness not specifiedEffort not specified | 48.45% | GPT-6 Cyber System CardChecked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced. |
| Gemini 4 Neon18 Nov 2026 | AntigravityEffort not specified | 48.3% | Introducing Gemini 4 NeonChecked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.single attempt per task · no internet access · 10h time cap per task · safety filters off · mitigations off (the default setting), per the model evaluationSource image |
| Gemini 4 Neon18 Nov 2026 | AntigravityEffort not specified | 47.9% | Introducing Gemini 4 NeonChecked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.single attempt per task · no internet access · 6h time cap per task · safety filters off · mitigations off (the default setting), per the model evaluation · another reportSource image |
| GPT-6 Astra3 Sep 2026 | Harness not specifiedEffort not specified | 42.43% | GPT-6 Cyber System CardChecked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.reported later |
| Gemini 4 Argon30 Sep 2026 | AntigravityEffort not specified | 42.0% | Gemini 4 Carbon Model evaluation: approach, methodology & resultsCorroborated The same number is printed in 1 other document: 1single attempt per task · no internet access · 10h time cap per task, per the Gemini 4 Carbon post’s chart · reported laterOur capture |
| Gemini 4 Argon30 Sep 2026 | AntigravityEffort not specified | 39.5% | Gemini 4 Carbon: our next frontier modelChecked A person checked this number against its source on 20 Nov 2026. This confirms the number matches what the lab published. It doesn't confirm that the score was reproduced.single attempt per task · no internet access · 6h time cap per task · mitigations off, per the model evaluation · reported later · another reportSource image |