Llama 2-13B | Epoch AI

ECI#225

106

Meta AI

Jul. 18, 2023

Open weights

Llama 2-13B is an open-weights model from Meta AI, released July 18, 2023. It has an ECI score of 106 and ranks 225th of 251 tracked models. At the time of its release, it ranked 8th of 20 tracked models.

Llama 2-13B vs select alternatives

Domain	Benchmark	Llama 2-13B Meta AI Jul. 18, 2023 Open weights	LLaMA-13B Meta AI Feb. 24, 2023 Open weights	LLaMA-33B Meta AI Feb. 24, 2023 Open weights	Falcon-40B Technology Innovation Institute May 25, 2023 Open weights
	ECI scoreBest score 167	106	100	107	104
	Ranking	#225	#235	#223	#229
Conceptual reasoning	BBHBest score 89%	58%	38%	50%	37%
Language understanding	LAMBADABest score 87%	77%	75%	77%	77%
	PIQABest score 89%	81%	80%	82%	83%
	BoolQBest score 91%	82%	79%	86%	83%
	HellaSwagBest score 95%	81%	79%	83%	85%
Mathematics	GSM8KBest score 95%	37%	21%	44%	34%
Science	OpenBookQABest score 88%	57%	56%	59%	57%
	ARC AI2Best score 95%	60%	53%	68%	62%
World knowledge	MMLUBest score 88%	56%	48%	59%	57%

Model metadata

General
Organization	Meta AI
Release date	Jul. 18, 2023
Model accessibility	Open weights
Country	United States of America
Knowledge cutoff	Unknown
Provider notes	Llama 2: Open Foundation and Fine-Tuned Chat Models

Pricing
Input price	$0.22 / 1M tokens
Output price	$0.22 / 1M tokens

Training
Parameters	1.3e10
Training compute	1.6e23 FLOP
Training hardware	NVIDIA A100 SXM4 80 GB
Training time	Unknown
Training dataset size	2.0e12 datapoints