Back to models

XGen-7B

ECI#242
93
Salesforce
Jun. 27, 2023
Open weights

XGen-7B is an open-weights model from Salesforce, released June 27, 2023. It has an ECI score of 93 and ranks 242nd of 249 tracked models. At the time of its release, it ranked 12th of 15 tracked models.

Input price—
Output price—
Parameters6.7e9
Training compute8.0e22 FLOP

XGen-7B vs select alternatives

Reasoning
DomainBenchmark
XGen-7B
Salesforce
Jun. 27, 2023
Open weights
MPT-7B
MosaicML
May 5, 2023
Open weights
Llama 2-7B
Meta AI
Jul. 18, 2023
Open weights
Falcon-40B
Technology Innovation Institute
May 25, 2023
Open weights
ECI scoreBest score 166
939499104
Ranking#242#239#234#227
Language understanding
PIQABest score 88.7%
75.5%
80.6%
78.8%
83.0%
WinoGrandeBest score 89.2%
64.9%
68.6%
69.2%
76.9%
BoolQBest score 91.2%
74.3%
75.0%
77.9%
83.1%
HellaSwagBest score 95.3%
74.2%
76.4%
77.2%
85.3%
Science
OpenBookQABest score 88.0%
40.2%
51.4%
58.6%
56.6%
ARC AI2Best score 95.3%
41.2%
42.6%
45.9%
61.9%
World knowledge
MMLUBest score 88.1%
36.3%
30.8%
45.8%
56.9%

Model metadata

General
OrganizationSalesforce
Release dateJun. 27, 2023
Model accessibilityOpen weights
CountryUnited States of America
Knowledge cutoffUnknown
Provider notesXGen-7B Technical Report
Pricing
Input price—
Output price—
Training
Parameters6.7e9
Training compute8.0e22 FLOP
Training hardwareGoogle TPU v4
Training timeUnknown
Training dataset size1.4e12 datapoints