Back to models

Dolly 2.0-12b

ECI#245
89
Databricks
Apr. 11, 2023
Open weights

Dolly 2.0-12b is an open-weights model from Databricks, released April 11, 2023. It has an ECI score of 89 and ranks 245th of 249 tracked models. At the time of its release, it ranked 6th of 7 tracked models.

Input price—
Output price—
Parameters1.2e10
Training computeUnknown

Dolly 2.0-12b vs select alternatives

Reasoning
DomainBenchmark
Dolly 2.0-12b
Databricks
Apr. 11, 2023
Open weights
MPT-7B
MosaicML
May 5, 2023
Open weights
Falcon-7B
Technology Innovation Institute
Apr. 24, 2023
Open weights
Cerebras-GPT-13B
Cerebras Systems
Mar. 20, 2023
Open weights
ECI scoreBest score 166
89949583
Ranking#245#239#238#248
Language understanding
PIQABest score 88.7%
75.4%
80.6%
80.3%
73.5%
WinoGrandeBest score 89.2%
61.8%
68.6%
67.2%
60.8%
BoolQBest score 91.2%
56.3%
75.0%
75.3%
61.1%
HellaSwagBest score 95.3%
70.8%
76.4%
78.1%
59.4%
Science
OpenBookQABest score 88.0%
39.2%
51.4%
51.6%
35.8%
ARC AI2Best score 95.3%
39.6%
42.6%
47.9%
32.4%
World knowledge
MMLUBest score 88.1%
26.2%
30.8%
35.0%
26.2%

Model metadata

General
OrganizationDatabricks
Release dateApr. 11, 2023
Model accessibilityOpen weights
CountryUnited States of America
Knowledge cutoffUnknown
Provider notesFree Dolly: Introducing the World's First Truly Open Instruction-Tuned LLM
Pricing
Input price—
Output price—
Training
Parameters1.2e10
Training computeUnknown
Training hardwareUnknown
Training timeUnknown
Training dataset size1.2e6 datapoints