Back to models

Llama 3-70B

ECI#184
123
Meta AI
Apr. 18, 2024
Open weights

Llama 3-70B is an open-weights model from Meta AI, released April 18, 2024. It has an ECI score of 123 and ranks 184th of 253 tracked models. At the time of its release, it ranked 6th of 56 tracked models.

Llama 3-70B vs select alternatives

DomainBenchmark
Llama 3-70B
Meta AI
Apr. 18, 2024
Open weights
Meta AI
Jul. 18, 2023
Open weights
Google DeepMind
May 23, 2024
Closed weights
Mistral AI
Apr. 17, 2024
Open weights
ECI scoreBest score 167
123114123122
Ranking#184#212#185#187
Conceptual reasoning
DTBenchBest score 99%
54%
42%
51%
55%
Long context
ForecastBenchBest score 62.5
57.151.453.956.3
Mathematics
MATH Level 5Best score 98%
23%
3%
25%
24%
OTIS Mock AIME 2024-2025Best score 100%
4%
0%
4%
n/a
Science
GPQA DiamondBest score 96%
41%
26%
40%
34%
Software engineering
CybenchBest score 93%
5%
n/a
n/a
8%
World knowledge
MMLUBest score 88%
79%
60%
78%
78%

Model metadata