IFBench
Created by Ai2 and University of Washington, 3 Jul 2025 · Higher is better · Website
- Other labs
- Reported in a later post or card
Results
| Model | Score | Source | Source check |
|---|---|---|---|
| Nemotron 3.5 Bolt15 Oct 2026 · NVIDIA | 68.71% | Nemotron 3.5 Bolt 74B-A9B 24GB: A Hybrid Vision-Language Model for Local AIBF16 weights | CheckedA person checked this number against its source on 31 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced. |
| Nemotron 3.5 Bolt15 Oct 2026 · NVIDIA | 66.17% | Nemotron 3.5 Bolt 74B-A9B 24GB: A Hybrid Vision-Language Model for Local AI24GB build with 2-bit (IQ2) weights; another report, not charted | CheckedA person checked this number against its source on 31 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced. |
| Nemotron 3.5 Super VL 120B-A12B15 Oct 2026 · NVIDIA | 73.04% | Nemotron 3.5 Bolt 74B-A9B 24GB: A Hybrid Vision-Language Model for Local AI | CheckedA person checked this number against its source on 31 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced. |
| Nemotron 3.5 Lightning 30B-A3B11 Aug 2026 · NVIDIA | 71.88% | nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 model card (revision of 2026-08-11)BF16 weightsOur capture | |
| Nemotron 3.5 Lightning 30B-A3B11 Aug 2026 · NVIDIA | 72.88% | Nemotron 3.5 Bolt 74B-A9B 24GB: A Hybrid Vision-Language Model for Local AIlater re-run; reported later; another report, not charted | CheckedA person checked this number against its source on 31 Oct 2026. This confirms the number matches what the lab published, not that the score was reproduced. |
| Nemotron 3 Super 120B-A12B11 Mar 2026 · NVIDIA | 71.92% | nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 model card (revision of 2026-08-11)later re-run; reported laterOur capture | |
| Nemotron 3 Nano 30B-A3B15 Dec 2025 · NVIDIA | 72.17% | nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 model card (revision of 2026-08-11)later re-run; reported laterOur capture | CorroboratedThe same number is printed in 1 other lab document: 1 |
