Back to models

Gopher (280B)

ECI
N/A
Google DeepMind
Dec. 8, 2021
Closed weights

Gopher (280B) is a closed-weights model from Google DeepMind, released December 8, 2021.

Gopher (280B) vs select alternatives

DomainBenchmark
Gopher (280B)
Google DeepMind
Dec. 8, 2021
Closed weights
Language understanding
LAMBADABest score 87%
75%
PIQABest score 89%
82%
WinoGrandeBest score 89%
70%
BoolQBest score 91%
79%
HellaSwagBest score 95%
79%
World knowledge
TriviaQABest score 88%
57%
MMLUBest score 88%
60%

Model metadata

General
OrganizationGoogle DeepMind
Release dateDec. 8, 2021
Model accessibilityClosed weights
CountryUnited Kingdom
Knowledge cutoffUnknown
Provider notes"Scaling Language Models: Methods, Analysis & Insights from Training Gopher"
Pricing
Input price—
Output price—
Training
Parameters2.8e11
Training compute6.3e23 FLOP
Training hardwareGoogle TPU v3
Training time38.3 days
Training dataset size3.0e11 datapoints