Llama 3.1-70B | Epoch AI

ECI#180

126

Meta AI

Jul. 23, 2024

Open weights

Llama 3.1-70B is an open-weights model from Meta AI, released July 23, 2024. It has an ECI score of 126 and ranks 180th of 257 tracked models. At the time of its release, it ranked 9th of 74 tracked models.

Llama 3.1-70B vs select alternatives

Domain	Benchmark	Llama 3.1-70B Meta AI Jul. 23, 2024 Open weights	Llama 3-70B Meta AI Apr. 18, 2024 Open weights	GPT-4o mini OpenAI Jul. 18, 2024 Closed weights	Qwen2-72B Alibaba Jun. 7, 2024 Open weights
	ECI scoreBest score 167	126	123	127	125
	Ranking	#180	#188	#178	#183
Agent	The Agent CompanyBest score 52%	13%	n/a	n/a	4%
Conceptual reasoning	LMCABest score 68.2	14.8	—	10.4	—
	DTBenchBest score 99%	60%	54%	54%	n/a
Games	BALROGBest score 68%	28%	n/a	17%	n/a
Mathematics	MATH Level 5Best score 98%	37%	23%	53%	39%
	OTIS Mock AIME 2024-2025Best score 100%	4%	4%	7%	n/a
Science	GPQA DiamondBest score 96%	44%	41%	38%	41%
Software engineering	WeirdML (v2)Best score 94%	9%	n/a	12%	11%
World knowledge	MMLUBest score 88%	80%	79%	82%	82%

Model metadata

General
Organization	Meta AI
Release date	Jul. 23, 2024
Model accessibility	Open weights
Country	United States of America
Knowledge cutoff	2023-12-01
Provider notes	The Llama 3 Herd of Models

Pricing
Input price	$0.40 / 1M tokens
Output price	$0.40 / 1M tokens

Training
Parameters	7.0e10
Training compute	7.9e24 FLOP
Training hardware	Unknown
Training time	Unknown
Training dataset size	1.5e13 datapoints