Back to models

Llama 4 Maverick

ECI#155
132
Meta AI
Apr. 6, 2025
Open weights

Llama 4 Maverick is an open-weights model from Meta AI, released April 6, 2025. It has an ECI score of 132 and ranks 155th of 260 tracked models. At the time of its release, it ranked 20th of 122 tracked models.

Llama 4 Maverick vs select alternatives

DomainBenchmark
Llama 4 Maverick
Meta AI
Apr. 6, 2025
Open weights
Llama 4 Scout
Meta AI
Apr. 5, 2025
Open weights
Mistral Medium 3
Mistral AI
May 7, 2025
Closed weights
Gemma 3 27B
Google DeepMind
Mar. 12, 2025
Open weights
ECI scoreBest score 167
132130134130
Ranking#155#163#149#161
Conceptual reasoning
ARC-AGI-2Best score 95%
0%
0%
n/a
n/a
ARC-AGI-1Best score 99%
4%
1%
n/a
n/a
Long context
ForecastBenchBest score 62.5
57.557.5——
Mathematics
MATH Level 5Best score 98%
73%
62%
82%
74%
OTIS Mock AIME 2024-2025Best score 100%
21%
8%
32%
23%
Science
Humanity's Last ExamBest score 55%
6%
n/a
5%
n/a
SciCodeBest score 67%
32%
21%
n/a
23%
GPQA DiamondBest score 96%
67%
52%
60%
48%
Software engineering
Aider PolyglotBest score 88%
16%
n/a
n/a
5%

Model metadata

General
OrganizationMeta AI
Release dateApr. 6, 2025
Model accessibilityOpen weights
CountryUnited States of America
Knowledge cutoff2024-08-01
Provider notesThe Llama 4 herd: The beginning of a new era of natively multimodal AI innovation
Pricing
Input price—
Output price—
Training
Parameters4.0e11
Training compute2.2e24 FLOP
Training hardwareUnknown
Training timeUnknown
Training dataset size3.0e13 datapoints