Back to models

Llama 4 Scout

ECI#152
130
Meta AI
Apr. 5, 2025
Open weights

Llama 4 Scout is an open-weights model from Meta AI, released April 5, 2025. It has an ECI score of 130 and ranks 152nd of 249 tracked models. At the time of its release, it ranked 25th of 121 tracked models.

Llama 4 Scout vs select alternatives

DomainBenchmark
Llama 4 Scout
Meta AI
Apr. 5, 2025
Open weights
Meta AI
Jul. 23, 2024
Open weights
OpenAI
Apr. 14, 2025
Closed weights
Google DeepMind
Mar. 12, 2025
Open weights
ECI scoreBest score 166
130129130130
Ranking#152#159#153#150
Conceptual reasoning
ARC-AGI-2Best score 95%
0%
n/a
0%
n/a
ARC-AGI-1Best score 99%
1%
n/a
0%
n/a
Long context
ForecastBenchBest score 62.5
57.559.9
Fiction.liveBenchBest score 97%
36%
n/a
25%
33%
Mathematics
MATH Level 5Best score 98%
62%
50%
70%
74%
OTIS Mock AIME 2024-2025Best score 100%
8%
10%
29%
23%
Science
CritPtBest score 32%
0%
n/a
0%
0%
SciCodeBest score 62%
17%
n/a
26%
21%
GPQA DiamondBest score 96%
52%
51%
49%
48%

Model metadata