Back to models

Grok 4

ECI#78
146
xAI
Jul. 9, 2025
Closed weights

Grok 4 is a closed-weights model from xAI, released July 9, 2025. It has an ECI score of 146 and ranks 78th of 253 tracked models. At the time of its release, it ranked 3rd of 140 tracked models.

Grok 4 vs select alternatives

DomainBenchmark
Grok 4
xAI
Jul. 9, 2025
Closed weights
xAI
Jun. 24, 2025
Closed weights
OpenAI
Jun. 10, 2025
Closed weights
Google DeepMind
Jun. 5, 2025
Closed weights
ECI scoreBest score 169
146140147145
Ranking#78#119#70#90
Agent
GDPvalBest score 50%
21%
n/a
n/a
23%
Conceptual reasoning
SimpleBenchBest score 82%
61%
n/a
n/a
62%
ARC-AGI-2Best score 95%
16%
0%
5%
5%
ARC-AGI-1Best score 99%
67%
17%
59%
41%
Mathematics
OTIS Mock AIME 2024-2025Best score 100%
84%
78%
n/a
84%
Science
GPQA DiamondBest score 96%
87%
76%
n/a
85%
Software engineering
METR Time HorizonsBest score 17 hr 25 min
1 hr 50 min——38 min 44 sec
Terminal-Bench 2.0Best score 85%
27%
n/a
n/a
33%
Aider PolyglotBest score 88%
80%
49%
85%
83%

Model metadata