Open-weight multimodal MoE trained jointly on text, images, audio, and video.
SI v3 uses weighted percentages from one Artificial Analysis configuration. Ranking requires all five benchmarks. Partial scores average only available weights. Scores are not comparable to SI v2 or a probability of reaching singularity.
Compared with models released within six months of it.
| Benchmark | Score | Rank |
|---|---|---|
LiveCodeBenchvals.ai Contamination-free competitive programming (filtered by cutoff date) | 85.9% | #23 / 62 |
MMLU-Provals.ai Harder 10-option successor to MMLU; more reasoning-focused | 86.3% | #38 / 61 |
MMMUvals.ai College-level multimodal reasoning across 30+ disciplines | 78.5% | #40 / 51 |
GPQAArtificial Analysis PhD-level science questions even experts struggle with | 89.5% | #43 / 96 |
HLEArtificial Analysis Challenging multidisciplinary questions evaluated by Artificial Analysis | 33.3% | #63 / 102 |
| Benchmark / source | Score |
|---|---|
HLE Artificial AnalysisInkling Small | 33.3% |
MMMU-Pro Artificial AnalysisInkling Small | 74% |
Terminal-Bench 2.1 Artificial AnalysisInkling Small | 55.1% |
Terminal-Bench 4.0 Artificial AnalysisInkling Small | 1% |
SciCode Artificial AnalysisInkling Small | 49.7% |
AA-LCR Artificial AnalysisInkling Small | 75.7% |
CritPt Artificial AnalysisInkling Small | 8.3% |