Frontier-tier successor to M2.7. AA Intelligence Index 54.7, GPQA 92.9, Arena 1668 — continues the open-weight cost-disruption pattern.
| Benchmark | Score | Rank |
|---|---|---|
Arena EloArtificial Analysis Human preference ranking via blind comparisons | 1668 | #2 / 51 |
GPQAArtificial Analysis PhD-level science questions even experts struggle with | 92.9% | #9 / 78 |
hleArtificial Analysis | 37.1% | #22 / 66 |
MMMUvals.ai College-level multimodal reasoning across 30+ disciplines | 81.2% | #25 / 51 |
TerminalArtificial Analysis Agentic terminal coding tasks requiring multi-step execution | 42.4% | #28 / 56 |
LiveCodeBenchvals.ai Contamination-free competitive programming (filtered by cutoff date) | 82.2% | #30 / 53 |
MMLU-Provals.ai Harder 10-option successor to MMLU; more reasoning-focused | 84.2% | #38 / 51 |