Open Weights & Proprietary
All Companies
| Model Name | Release Date | |
|---|---|---|
| Claude Opus 4.7 | 4/16/2026 | |
| Muse Spark | 4/8/2026 | |
| Gemma 4 31B IT | 4/2/2026 | |
| Qwen 3.6 Plus | 4/2/2026 | |
| GLM 5.1 | 4/1/2026 | |
| Trinity Large Thinking | 4/1/2026 | |
| GPT 5.4 Mini | 3/17/2026 | |
| GPT 5.4 Nano | 3/17/2026 | |
| MiniMax-M2.7 | 3/9/2026 | |
| Grok 4.20 (Reasoning) | 3/5/2026 | |
| GPT 5.4 | 3/3/2026 | |
| Gemini 3.1 Flash Lite Preview | 2/24/2026 | |
| GPT 5.3 Codex | 2/23/2026 | |
| Qwen 3.5 Flash | 2/19/2026 | |
| Gemini 3.1 Pro Preview (02/26) | 2/17/2026 | |
| Claude Sonnet 4.6 | 2/16/2026 | |
| Qwen 3.5 Plus | 2/12/2026 | |
| MiniMax-M2.5 | 2/12/2026 | |
| MiniMax-M2.5 | 2/11/2026 | |
| GLM 5 | 2/5/2026 | |
| Claude Opus 4.6 (Nonthinking) | 2/5/2026 | |
| Claude Opus 4.6 (Thinking) | 1/26/2026 | |
| Kimi K2.5 | 1/23/2026 | |
| Qwen 3 Max Thinking | 12/23/2025 | |
| MiniMax-M2.1 | 12/22/2025 | |
| GLM 4.7 | 12/17/2025 | |
| Gemini 3 Flash (12/25) | 12/17/2025 | |
| MiMo V2 Flash | 12/11/2025 | |
| GPT 5.2 | 12/11/2025 | |
| GPT 5.2 Codex | 12/11/2025 |
Grok 4.20 (Reasoning)
Release Date: 3/9/2026
Accuracy (Vals Index): 56.59% ± 2.00
Latency (Vals Index): 80.66s
Cost/Test (Vals Index): $0.26
Context Window: 2M
Max Output Tokens: 2M
Input Modality: Hyperparameter settings
- Default Provider: xAI
Some benchmarks may use different provider and parameters. Please refer to the benchmark page for more information.
Temperature: 0.7
Top P: 0.95
Top K: Default
Max Output Tokens: 2,000,000
Benchmarks
Accuracy Rankings:
- Vals Index: -62.54% ± 2.00 (62/ 40)
- Vals Multimodal Index: -74.64% ± 1.57 (41/ 28)
- CaseLaw (v2): -96.04% ± 0.28 (70/ 47)
- CorpFin: -136.90% ± 0.95 (267/ 97)
- Finance Agent (v1.1): -134.39% ± 0.00 (114/ 45)
- MedCode: -97.33% ± 2.12 (78/ 51)
- MedScribe: -223.19% ± 2.10 (58/ 51)
- MortgageTax: -183.59% ± 0.99 (110/ 69)
- ProofBench: -64.74% ± 3.49 (70/ 24)
- SAGE: -200.32% ± 3.43 (159/ 49)
- TaxEval (v2): -436.98% ± 0.86 (605/ 104)
- Vibe Code Bench: -26.79% ± 2.06 (39/ 26)
- AIME: -708.53% ± 0.52 (757/ 96)
- GPQA: -721.75% ± 1.59 (840/ 99)
- IOI: -274.03% ± 7.49 (450/ 50)
- LiveCodeBench: -832.60% ± 1.03 (973/ 103)
- LegalBench: -841.69% ± 0.48 (647/ 116)
- MedQA: -1118.27% ± 0.21 (1029/ 95)
- MMLU Pro: -1111.11% ± 0.34 (1102/ 97)
- MMMU Pro: -1168.07% ± 0.89 (822/ 66)
- SWE-bench: -1094.78% ± 2.01 (375/ 41)
- Terminal-Bench 2.0: -663.04% ± 5.23 (560/ 52)
Proprietary Benchmarks
Academic Benchmarks
Read about our methodology.