Back to models

OPT-66B

ECI
N/A
Meta AI
May 3, 2022
Open weights

OPT-66B is an open-weights model from Meta AI, released May 3, 2022.

OPT-66B vs select alternatives

DomainBenchmark
OPT-66B
Meta AI
May 3, 2022
Open weights
Language understanding
BoolQBest score 91%
76%
HellaSwagBest score 95%
75%
Mathematics
GSM8KBest score 95%
2%

Model metadata

General
OrganizationMeta AI
Release dateMay 3, 2022
Model accessibilityOpen weights
CountryUnited States of America
Knowledge cutoffUnknown
Provider notesOPT: Open Pre-trained Transformer Language Models
Pricing
Input price—
Output price—
Training
Parameters6.6e10
Training compute1.1e23 FLOP
Training hardwareNVIDIA A100 SXM4 80 GB
Training timeUnknown
Training dataset size1.8e11 datapoints