Top-performing Chinese open model, strong coding + reasoning
| Benchmark | Score | Rank |
|---|---|---|
TerminalArtificial Analysis Agentic terminal coding tasks requiring multi-step execution | 43.2% | #27 / 56 |
MMLU-Provals.ai Harder 10-option successor to MMLU; more reasoning-focused | 86.9% | #32 / 58 |
LiveCodeBenchvals.ai Contamination-free competitive programming (filtered by cutoff date) | 81.4% | #39 / 59 |
hleArtificial Analysis | 28% | #48 / 79 |
GPQAArtificial Analysis PhD-level science questions even experts struggle with | 86.8% | #54 / 91 |