Llama 2-7B | Epoch AI

ECI#238

99

Meta AI

Jul. 18, 2023

Open weights

Llama 2-7B is an open-weights model from Meta AI, released July 18, 2023. It has an ECI score of 99 and ranks 238th of 253 tracked models. At the time of its release, it ranked 13th of 20 tracked models.

Llama 2-7B vs select alternatives

Domain	Benchmark	Llama 2-7B Meta AI Jul. 18, 2023 Open weights	LLaMA-7B Meta AI Feb. 24, 2023 Open weights	LLaMA-13B Meta AI Feb. 24, 2023 Open weights	MPT-30B MosaicML Jun. 22, 2023 Open weights
	ECI scoreBest score 167	99	97	101	101
	Ranking	#238	#239	#237	#236
Conceptual reasoning	BBHBest score 89%	39%	34%	38%	38%
Language understanding	LAMBADABest score 87%	73%	73%	75%	n/a
	PIQABest score 89%	79%	80%	80%	82%
	BoolQBest score 91%	78%	77%	79%	85%
	HellaSwagBest score 95%	77%	76%	79%	n/a
Mathematics	GSM8KBest score 95%	17%	11%	21%	34%
Science	OpenBookQABest score 88%	59%	57%	56%	52%
	ARC AI2Best score 95%	46%	48%	53%	51%
World knowledge	MMLUBest score 88%	46%	36%	48%	48%

Model metadata

General
Organization	Meta AI
Release date	Jul. 18, 2023
Model accessibility	Open weights
Country	United States of America
Knowledge cutoff	Unknown
Provider notes	Llama 2: Open Foundation and Fine-Tuned Chat Models

Pricing
Input price	—
Output price	—

Training
Parameters	7.0e9
Training compute	8.4e22 FLOP
Training hardware	NVIDIA A100 SXM4 80 GB
Training time	Unknown
Training dataset size	2.0e12 datapoints