Back to models

Llama 2-7B

ECI#234
99
Meta AI
Jul. 18, 2023
Open weights

Llama 2-7B is an open-weights model from Meta AI, released July 18, 2023. It has an ECI score of 99 and ranks 234th of 249 tracked models. At the time of its release, it ranked 13th of 20 tracked models.

Input price
Output price
Parameters7.0e9
Training compute8.4e22 FLOP

Llama 2-7B vs select alternatives

DomainBenchmark
Llama 2-7B
Meta AI
Jul. 18, 2023
Open weights
Meta AI
Feb. 24, 2023
Open weights
Meta AI
Feb. 24, 2023
Open weights
MosaicML
Jun. 22, 2023
Open weights
ECI scoreBest score 166
9996100100
Ranking#234#235#233#232
Conceptual reasoning
BBHBest score 89.2%
39.2%
33.5%
37.9%
38.0%
Language understanding
LAMBADABest score 87.2%
73.3%
73.3%
75.2%
n/a
PIQABest score 88.7%
78.8%
79.8%
80.1%
81.9%
BoolQBest score 91.2%
77.9%
76.5%
78.7%
85.0%
HellaSwagBest score 95.3%
77.2%
76.2%
79.2%
n/a
Mathematics
GSM8KBest score 94.5%
16.7%
11.0%
20.5%
34.4%
Science
OpenBookQABest score 88.0%
58.6%
57.2%
56.4%
52.0%
ARC AI2Best score 95.3%
45.9%
47.6%
52.7%
50.6%
World knowledge
MMLUBest score 88.1%
45.8%
35.6%
47.7%
47.9%

Model metadata