Back to models

Llama 2-70B

ECI#208
114
Meta AI
Jul. 18, 2023
Open weights

Llama 2-70B is an open-weights model from Meta AI, released July 18, 2023. It has an ECI score of 114 and ranks 208th of 249 tracked models. At the time of its release, it ranked 4th of 20 tracked models.

Input price—
Output price—
Parameters7.0e10
Training compute8.1e23 FLOP

Llama 2-70B vs select alternatives

Reasoning
DomainBenchmark
Llama 2-70B
Meta AI
Jul. 18, 2023
Open weights
LLaMA-65B
Meta AI
Feb. 24, 2023
Open weights
GPT-4 (Mar 2023)
OpenAI
Mar. 14, 2023
Closed weights
Claude 2
Anthropic
Jul. 11, 2023
Closed weights
ECI scoreBest score 166
114110126120
Ranking#208#216#173#189
Conceptual reasoning
BBHBest score 89.2%
58.5%
58.4%
n/a
n/a
DTBenchBest score 98.4%
41.6%
n/a
n/a
51.9%
Mathematics
GSM8KBest score 94.5%
58.7%
54.4%
92.0%
n/a
MATH Level 5Best score 98.1%
3.3%
n/a
n/a
11.7%
OTIS Mock AIME 2024-2025Best score 100.0%
0.0%
n/a
0.6%
2.5%
Science
GPQA DiamondBest score 95.8%
26.3%
n/a
35.7%
34.7%
World knowledge
MMLUBest score 88.1%
59.9%
63.4%
86.4%
78.5%

Model metadata

General
OrganizationMeta AI
Release dateJul. 18, 2023
Model accessibilityOpen weights
CountryUnited States of America
Knowledge cutoff2023-07-01
Provider notesLlama 2: Open Foundation and Fine-Tuned Chat Models
Pricing
Input price—
Output price—
Training
Parameters7.0e10
Training compute8.1e23 FLOP
Training hardwareNVIDIA A100 SXM4 80 GB
Training time72 days
Training dataset size2.0e12 datapoints