Highest AA Intelligence Index of the August frontier wave at 60.9, and the catalog's top GPQA at 94.9.
| Benchmark | Score | Rank |
|---|---|---|
GPQAArtificial Analysis PhD-level science questions even experts struggle with | 94.9% | #1 / 88 |
AA Intelligence Independent composite of agentic work, coding, scientific reasoning, and general capability | 60.9% | #1 / 18 |
aaAgentic | 58.7% | #2 / 12 |
LiveCodeBenchvals.ai Contamination-free competitive programming (filtered by cutoff date) | 88.2% | #5 / 59 |
AA Coding Independent composite of implementation, terminal use, and real-codebase agent performance | 76.8% | #5 / 18 |
MMLU-Provals.ai Harder 10-option successor to MMLU; more reasoning-focused | 89.4% | #9 / 58 |
ARC-AGIARC Prize Novel reasoning tasks requiring fluid intelligence | 68.3% | #11 / 30 |
hleArtificial Analysis | 42.9% | #12 / 76 |