Grok-2 (Dec 2024)
ECI#152
130Grok-2 (Dec 2024) is a closed-weights model from xAI, released December 12, 2024. It has an ECI score of 130 and ranks 152nd of 253 tracked models. At the time of its release, it ranked 6th of 100 tracked models.
Grok-2 (Dec 2024) vs select alternatives
| Domain | Benchmark | Grok-2 (Dec 2024) | |||
|---|---|---|---|---|---|
ECI scoreBest score 167 | 130 | 130 | 129 | 132 | |
| Ranking | #152 | #153 | #161 | #147 | |
| Conceptual reasoning | SimpleBenchBest score 82% | ||||
| Mathematics | MATH Level 5Best score 98% | ||||
OTIS Mock AIME 2024-2025Best score 100% | |||||
| Science | GPQA DiamondBest score 96% | ||||
| Software engineering | WeirdML (v2)Best score 94% | ||||
| Writing & creativity | Lech Mazur WritingBest score 8.6 | 6.4 | 6.3 | 8.2 | — |
| Other | LiveBenchBest score 82% |
