First 10M token context window, 17B active params from 109B MoE
| Benchmark | Score | Rank |
|---|---|---|
MATH Competition-level mathematics problems | 50.3% | #45 / 50 |
MMMUArtificial Analysis College-level multimodal reasoning across 30+ disciplines | 52.9% | #45 / 46 |
MMLU Tests knowledge across 57 subjects from STEM to humanities | 79.6% | #48 / 54 |
TerminalArtificial Analysis Agentic terminal coding tasks requiring multi-step execution | 1.5% | #56 / 56 |
hleArtificial Analysis | 4.3% | #57 / 61 |
GPQA PhD-level science questions even experts struggle with | 57.2% | #63 / 73 |