Frontier-tier Qwen flagship. AA Intelligence Index 56.6, GPQA 92.3, Terminal-Bench 50.8 — closes the gap to Western frontier at lower cost.
| Benchmark | Score | Rank |
|---|---|---|
Arena EloArtificial Analysis Human preference ranking via blind comparisons | 1545 | #5 / 51 |
MMLU-Provals.ai Harder 10-option successor to MMLU; more reasoning-focused | 89.3% | #11 / 58 |
LiveCodeBenchvals.ai Contamination-free competitive programming (filtered by cutoff date) | 87.1% | #15 / 59 |
GPQAArtificial Analysis PhD-level science questions even experts struggle with | 92.3% | #18 / 91 |
TerminalArtificial Analysis Agentic terminal coding tasks requiring multi-step execution | 50.8% | #18 / 56 |
hleArtificial Analysis | 38.1% | #26 / 79 |