Back to models

Grok-2 (Dec 2024)

ECI#158
130
xAI
Dec. 12, 2024
Closed weights

Grok-2 (Dec 2024) is a closed-weights model from xAI, released December 12, 2024. It has an ECI score of 130 and ranks 158th of 240 tracked models. At the time of its release, it ranked 6th of 85 tracked models.

Grok-2 (Dec 2024) vs select alternatives

DomainBenchmark
Grok-2 (Dec 2024)
xAI
Dec. 12, 2024
Closed weights
Phi-4
Microsoft
Dec. 12, 2024
Open weights
GPT-4o (Nov 2024)
OpenAI
Nov. 20, 2024
Closed weights
Qwen2.5-Max
Alibaba
Jan. 25, 2025
Closed weights
ECI scoreBest score 173
130129129131
Ranking#158#159#160#155
Mathematics
MATH Level 5Best score 98%
64%
65%
50%
67%
OTIS Mock AIME 2024-2025Best score 100%
12%
14%
6%
16%
Science
GPQA DiamondBest score 97%
54%
56%
48%
56%
Software engineering
WeirdML (v2)Best score 94%
22%
n/a
25%
n/a
Writing & creativity
Lech Mazur WritingBest score 8.6
6.46.38.27.3
Other
LiveBenchBest score 82%
54%
42%
52%
62%

Model metadata

General
OrganizationxAI
Release dateDec. 12, 2024
Model accessibilityClosed weights
CountryUnited States of America
Knowledge cutoffUnknown
Provider notesGrok-2 Beta Release
Pricing
Input price$2 / 1M tokens
Output price$10 / 1M tokens
Training
ParametersUnknown
Training compute3.0e25 FLOP
Training hardwareNVIDIA H100 SXM5 80GB
Training timeUnknown
Training dataset sizeUnknown