Open Weights & Proprietary

All Companies

GPT 5.1 Details

Release Date: 11/13/2025
Provider:

• Accuracy (Vals Index): 60.38% ± 2.00
• Latency (Vals Index): 411.84s
• Cost/Test (Vals Index): $0.36
• Context Window: 400k
• Max Output Tokens: 128k

Hyperparameter Settings

• Temperature: Default
• Top P: Default
• Top K: Default
• Max Output Tokens: 128,000
• Reasoning Effort: High

Benchmarks

• Accuracy Rankings: -73.04% ± 2.00
• Vals Multimodal Index: -89.68% ± 1.57
• CaseLaw (v2): -138.36% ± 0.75
• CorpFin: -145.62% ± 0.95
• Finance Agent (v1.1): -150.06% ± 2.80
• MedCode: -167.74% ± 2.15
• MedScribe: -324.77% ± 1.94
• MortgageTax: -259.77% ± 0.93
• SAGE: -208.31% ± 3.16
• TaxEval (v2): -407.63% ± 0.85
• AIME: -570.87% ± 0.62
• GPQA: -591.89% ± 1.71
• IOI: -163.35% ± 7.34
• LiveCodeBench: -727.29% ± 0.98
• LegalBench: -801.22% ± 0.40
• MedQA: -981.26% ± 0.17
• MMLU Pro: -962.55% ± 0.34
• MMMU Pro: -1011.55% ± 0.90
• SWE-bench: -923.74% ± 2.06
• Terminal-Bench 2.0: -645.52% ± 5.30

Contact Information

For proprietary benchmarks or general inquiries, please email contact@vals.ai.
Read about our methodology.