Back to models

Llama 3.3 70B

ECI#172
127
Meta AI
Dec. 6, 2024
Open weights

Llama 3.3 70B is an open-weights model from Meta AI, released December 6, 2024. It has an ECI score of 127 and ranks 172nd of 257 tracked models. At the time of its release, it ranked 15th of 97 tracked models.

Llama 3.3 70B vs select alternatives

DomainBenchmark
Llama 3.3 70B
Meta AI
Dec. 6, 2024
Open weights
Meta AI
Jul. 23, 2024
Open weights
Meta AI
Jul. 23, 2024
Open weights
Anthropic
Oct. 22, 2024
Closed weights
ECI scoreBest score 167
127126129127
Ranking#172#180#167#174
Conceptual reasoning
SimpleBenchBest score 82%
20%
n/a
23%
n/a
Long context
ForecastBenchBest score 62.5
58.6—59.9—
Mathematics
MATH Level 5Best score 98%
42%
37%
50%
46%
OTIS Mock AIME 2024-2025Best score 100%
5%
4%
10%
4%
Science
CritPtBest score 32%
0%
n/a
n/a
0%
SciCodeBest score 67%
26%
n/a
n/a
27%
GPQA DiamondBest score 96%
47%
44%
51%
38%
Software engineering
WeirdML (v2)Best score 94%
14%
9%
21%
31%
Other
LiveBenchBest score 82%
50%
n/a
n/a
43%

Model metadata