Back to models

Llama 2-34B

ECI#224
105
Meta AI
Jul. 18, 2023
Closed weights

Llama 2-34B is a closed-weights model from Meta AI, released July 18, 2023. It has an ECI score of 105 and ranks 224th of 249 tracked models. At the time of its release, it ranked 9th of 20 tracked models.

Input price—
Output price—
Parameters3.4e10
Training compute4.1e23 FLOP

Llama 2-34B vs select alternatives

Reasoning
DomainBenchmark
Llama 2-34B
Meta AI
Jul. 18, 2023
Closed weights
LLaMA-13B
Meta AI
Feb. 24, 2023
Open weights
LLaMA-33B
Meta AI
Feb. 24, 2023
Open weights
Falcon-40B
Technology Innovation Institute
May 25, 2023
Open weights
ECI scoreBest score 166
105100107104
Ranking#224#233#221#227
Conceptual reasoning
BBHBest score 89.2%
44.1%
37.9%
50.0%
37.1%
Language understanding
PIQABest score 88.7%
81.9%
80.1%
82.3%
83.0%
WinoGrandeBest score 89.2%
76.7%
73.0%
76.0%
76.9%
BoolQBest score 91.2%
83.7%
78.7%
86.1%
83.1%
Mathematics
GSM8KBest score 94.5%
42.2%
20.5%
44.1%
33.8%
Science
OpenBookQABest score 88.0%
58.2%
56.4%
58.6%
56.6%
ARC AI2Best score 95.3%
54.5%
52.7%
67.5%
61.9%
World knowledge
TriviaQABest score 87.5%
84.6%
77.9%
83.8%
79.9%
MMLUBest score 88.1%
62.6%
47.7%
58.7%
56.9%

Model metadata

General
OrganizationMeta AI
Release dateJul. 18, 2023
Model accessibilityClosed weights
CountryUnited States of America
Knowledge cutoffUnknown
Provider notesLlama 2: Open Foundation and Fine-Tuned Chat Models
Pricing
Input price—
Output price—
Training
Parameters3.4e10
Training compute4.1e23 FLOP
Training hardwareNVIDIA A100 SXM4 80 GB
Training timeUnknown
Training dataset size2.0e12 datapoints