Back to models

T5-11B

ECI
N/A
Google DeepMind
Oct. 23, 2019
Open weights

T5-11B is an open-weights model from Google DeepMind, released October 23, 2019.

T5-11B vs select alternatives

DomainBenchmark
T5-11B
Google DeepMind
Oct. 23, 2019
Open weights
Language understanding
CommonSenseQA 2Best score 68%
68%
SuperGLUEBest score 89%
89%
BoolQBest score 91%
91%

Model metadata

General
OrganizationGoogle DeepMind
Release dateOct. 23, 2019
Model accessibilityOpen weights
CountryUnited States of America
Knowledge cutoffUnknown
Provider notesExploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Pricing
Input price—
Output price—
Training
Parameters1.1e10
Training compute3.3e22 FLOP
Training hardwareGoogle TPU v3
Training time20.1 days
Training dataset size3.4e10 datapoints