Back to models

Llama 4 Maverick

ECI#144
132
Meta AI
Apr. 6, 2025
Open weights

Llama 4 Maverick is an open-weights model from Meta AI, released April 6, 2025. It has an ECI score of 132 and ranks 144th of 249 tracked models. At the time of its release, it ranked 20th of 122 tracked models.

Llama 4 Maverick vs select alternatives

DomainBenchmark
Llama 4 Maverick
Meta AI
Apr. 6, 2025
Open weights
Meta AI
Apr. 5, 2025
Open weights
Mistral AI
May 7, 2025
Closed weights
Google DeepMind
Mar. 12, 2025
Open weights
ECI scoreBest score 166
132130134130
Ranking#144#152#138#150
Conceptual reasoning
ARC-AGI-2Best score 95%
0%
0%
n/a
n/a
ARC-AGI-1Best score 99%
4%
1%
n/a
n/a
Long context
ForecastBenchBest score 62.5
57.557.5
Mathematics
MATH Level 5Best score 98%
73%
62%
82%
74%
OTIS Mock AIME 2024-2025Best score 100%
21%
8%
32%
23%
Science
Humanity's Last ExamBest score 47%
6%
n/a
5%
n/a
SciCodeBest score 62%
33%
17%
n/a
21%
GPQA DiamondBest score 96%
67%
52%
60%
48%
Software engineering
Aider PolyglotBest score 88%
16%
n/a
n/a
5%

Model metadata