Back to models

Grok 4

ECI#85
147
xAI
Jul. 9, 2025
Closed weights

Grok 4 is a closed-weights model from xAI, released July 9, 2025. It has an ECI score of 147 and ranks 85th of 240 tracked models. At the time of its release, it ranked 3rd of 125 tracked models.

Grok 4 vs select alternatives

DomainBenchmark
Grok 4
xAI
Jul. 9, 2025
Closed weights
xAI
Jun. 24, 2025
Closed weights
OpenAI
Jun. 10, 2025
Closed weights
Google DeepMind
Jun. 5, 2025
Closed weights
ECI scoreBest score 173
147140147145
Ranking#85#126#81#96
Agent
GDPvalBest score 50%
21%
n/a
n/a
23%
Conceptual reasoning
SimpleBenchBest score 95%
61%
n/a
n/a
62%
ARC-AGI-2Best score 95%
16%
0%
5%
5%
ARC-AGI-1Best score 99%
67%
17%
59%
41%
Mathematics
OTIS Mock AIME 2024-2025Best score 100%
84%
78%
n/a
84%
Science
GPQA DiamondBest score 97%
87%
76%
n/a
85%
Software engineering
METR Time HorizonsBest score 17 hr 25 min
1 hr 50 min——38 min 44 sec
Terminal-Bench 2.0Best score 85%
27%
n/a
n/a
33%
Aider PolyglotBest score 88%
80%
49%
85%
83%

Model metadata