Grok-2 (Dec 2024)
ECI#158
130Grok-2 (Dec 2024) is a closed-weights model from xAI, released December 12, 2024. It has an ECI score of 130 and ranks 158th of 253 tracked models. At the time of its release, it ranked 7th of 96 tracked models.
Grok-2 (Dec 2024) vs select alternatives
| Domain | Benchmark | Grok-2 (Dec 2024) | |||
|---|---|---|---|---|---|
ECI scoreBest score 169 | 130 | 130 | 129 | 132 | |
| Ranking | #158 | #157 | #168 | #154 | |
| Conceptual reasoning | SimpleBenchBest score 82% | ||||
| Mathematics | MATH Level 5Best score 98% | ||||
OTIS Mock AIME 2024-2025Best score 100% | |||||
| Science | GPQA DiamondBest score 96% | ||||
| Software engineering | WeirdML (v2)Best score 94% | ||||
| Writing & creativity | Lech Mazur WritingBest score 8.6 | 6.4 | 6.3 | 8.2 | — |
| Other | LiveBenchBest score 82% |
