Back to models

Llama 3-70B

ECI#186
123
Meta AI
Apr. 18, 2024
Open weights

Llama 3-70B is an open-weights model from Meta AI, released April 18, 2024. It has an ECI score of 123 and ranks 186th of 253 tracked models. At the time of its release, it ranked 6th of 55 tracked models.

Llama 3-70B vs select alternatives

DomainBenchmark
Llama 3-70B
Meta AI
Apr. 18, 2024
Open weights
Meta AI
Jul. 18, 2023
Open weights
Google DeepMind
May 23, 2024
Closed weights
Mistral AI
Feb. 26, 2024
Closed weights
ECI scoreBest score 169
123114123122
Ranking#186#214#187#189
Conceptual reasoning
DTBenchBest score 99%
54%
42%
51%
56%
Long context
ForecastBenchBest score 67.0
60.250.458.6—
Mathematics
MATH Level 5Best score 98%
23%
3%
25%
24%
OTIS Mock AIME 2024-2025Best score 100%
4%
0%
4%
2%
Science
GPQA DiamondBest score 96%
41%
26%
40%
39%
World knowledge
MMLUBest score 88%
79%
60%
78%
69%

Model metadata