Llama 2-34B | Epoch AI

ECI#228

105

Meta AI

Jul. 18, 2023

Closed weights

Llama 2-34B is a closed-weights model from Meta AI, released July 18, 2023. It has an ECI score of 105 and ranks 228th of 253 tracked models. At the time of its release, it ranked 9th of 20 tracked models.

Llama 2-34B vs select alternatives

Domain	Benchmark	Llama 2-34B Meta AI Jul. 18, 2023 Closed weights	LLaMA-13B Meta AI Feb. 24, 2023 Open weights	LLaMA-33B Meta AI Feb. 24, 2023 Open weights	Falcon-40B Technology Innovation Institute May 25, 2023 Open weights
	ECI scoreBest score 167	105	101	107	104
	Ranking	#228	#237	#225	#231
Conceptual reasoning	BBHBest score 89%	44%	38%	50%	37%
Language understanding	PIQABest score 89%	82%	80%	82%	83%
	WinoGrandeBest score 89%	77%	73%	76%	77%
	BoolQBest score 91%	84%	79%	86%	83%
Mathematics	GSM8KBest score 95%	42%	21%	44%	34%
Science	OpenBookQABest score 88%	58%	56%	59%	57%
	ARC AI2Best score 95%	55%	53%	68%	62%
World knowledge	TriviaQABest score 88%	85%	78%	84%	80%
	MMLUBest score 88%	63%	48%	59%	57%

Model metadata

General
Organization	Meta AI
Release date	Jul. 18, 2023
Model accessibility	Closed weights
Country	United States of America
Knowledge cutoff	Unknown
Provider notes	Llama 2: Open Foundation and Fine-Tuned Chat Models

Pricing
Input price	—
Output price	—

Training
Parameters	3.4e10
Training compute	4.1e23 FLOP
Training hardware	NVIDIA A100 SXM4 80 GB
Training time	Unknown
Training dataset size	2.0e12 datapoints