Llama 2-34B | Epoch AI

ECI#219

94

Meta AI

Jul. 18, 2023

Closed weights

Llama 2-34B is a closed-weights model from Meta AI, released July 18, 2023. It has an ECI score of 94 and ranks 219th of 240 tracked models. At the time of its release, it ranked 9th of 19 tracked models.

Llama 2-34B vs select alternatives

Domain	Benchmark	Llama 2-34B Meta AI Jul. 18, 2023 Closed weights	LLaMA-13B Meta AI Feb. 24, 2023 Open weights	LLaMA-33B Meta AI Feb. 24, 2023 Open weights	Baichuan2-13B Baichuan Sep. 6, 2023 Open weights
	ECI scoreBest score 173	94	85	97	92
	Ranking	#219	#225	#215	#220
Conceptual reasoning	BBHBest score 89%	44%	38%	50%	49%
Language understanding	PIQABest score 89%	82%	80%	82%	78%
	WinoGrandeBest score 89%	77%	73%	76%	n/a
	BoolQBest score 91%	84%	79%	86%	67%
Mathematics	GSM8KBest score 95%	42%	21%	44%	53%
Science	OpenBookQABest score 88%	58%	56%	59%	n/a
	ARC AI2Best score 95%	55%	53%	68%	38%
World knowledge	TriviaQABest score 88%	85%	78%	84%	n/a
	MMLUBest score 88%	63%	48%	59%	59%

Model metadata

General
Organization	Meta AI
Release date	Jul. 18, 2023
Model accessibility	Closed weights
Country	United States of America
Knowledge cutoff	Unknown
Provider notes	Llama 2: Open Foundation and Fine-Tuned Chat Models

Pricing
Input price	—
Output price	—

Training
Parameters	3.4e10
Training compute	4.1e23 FLOP
Training hardware	NVIDIA A100 SXM4 80 GB
Training time	Unknown
Training dataset size	2.0e12 datapoints