Llama 2-70B | Epoch AI

ECI#207

106

Meta AI

Jul. 18, 2023

Open weights

Llama 2-70B is an open-weights model from Meta AI, released July 18, 2023. It has an ECI score of 106 and ranks 207th of 240 tracked models. At the time of its release, it ranked 5th of 19 tracked models.

Llama 2-70B vs select alternatives

Domain	Benchmark	Llama 2-70B Meta AI Jul. 18, 2023 Open weights	LLaMA-65B Meta AI Feb. 24, 2023 Open weights	GPT-4 (Mar 2023) OpenAI Mar. 14, 2023 Closed weights	Claude 2 Anthropic Jul. 11, 2023 Closed weights
	ECI scoreBest score 173	106	102	122	117
	Ranking	#207	#211	#180	#191
Conceptual reasoning	BBHBest score 89%	59%	58%	n/a	n/a
	DTBenchBest score 99%	42%	n/a	n/a	52%
Mathematics	GSM8KBest score 95%	59%	54%	92%	n/a
	MATH Level 5Best score 98%	3%	n/a	n/a	12%
	OTIS Mock AIME 2024-2025Best score 100%	0%	n/a	1%	3%
Science	GPQA DiamondBest score 97%	26%	n/a	36%	35%
World knowledge	MMLUBest score 88%	60%	63%	86%	79%

Model metadata

General
Organization	Meta AI
Release date	Jul. 18, 2023
Model accessibility	Open weights
Country	United States of America
Knowledge cutoff	2023-07-01
Provider notes	Llama 2: Open Foundation and Fine-Tuned Chat Models

Pricing
Input price	—
Output price	—

Training
Parameters	7.0e10
Training compute	8.1e23 FLOP
Training hardware	NVIDIA A100 SXM4 80 GB
Training time	72 days
Training dataset size	2.0e12 datapoints