Back to models

Llama 4 Maverick

ECI#153
132
Meta AI
Apr. 6, 2025
Open weights

Llama 4 Maverick is an open-weights model from Meta AI, released April 6, 2025. It has an ECI score of 132 and ranks 153rd of 240 tracked models. At the time of its release, it ranked 15th of 101 tracked models.

Llama 4 Maverick vs select alternatives

DomainBenchmark
Llama 4 Maverick
Meta AI
Apr. 6, 2025
Open weights
Llama 3.1-405B
Meta AI
Jul. 23, 2024
Open weights
Mistral Medium 3
Mistral AI
May 7, 2025
Closed weights
GPT-4.1 mini
OpenAI
Apr. 14, 2025
Closed weights
ECI scoreBest score 173
132128133134
Ranking#153#162#151#144
Conceptual reasoning
SimpleBenchBest score 95%
28%
23%
n/a
n/a
ARC-AGI-2Best score 95%
0%
n/a
n/a
0%
ARC-AGI-1Best score 99%
4%
n/a
n/a
4%
Mathematics
MATH Level 5Best score 98%
73%
50%
82%
87%
OTIS Mock AIME 2024-2025Best score 100%
21%
10%
32%
45%
Science
Humanity's Last ExamBest score 55%
6%
n/a
5%
n/a
GPQA DiamondBest score 97%
67%
51%
60%
66%
Software engineering
Aider PolyglotBest score 88%
16%
n/a
n/a
32%
WeirdML (v2)Best score 94%
24%
21%
n/a
38%

Model metadata

General
OrganizationMeta AI
Release dateApr. 6, 2025
Model accessibilityOpen weights
CountryUnited States of America
Knowledge cutoff2024-08-01
Provider notesThe Llama 4 herd: The beginning of a new era of natively multimodal AI innovation
Pricing
Input price—
Output price—
Training
Parameters4.0e11
Training compute2.2e24 FLOP
Training hardwareUnknown
Training timeUnknown
Training dataset size3.0e13 datapoints