Back to models

T5-3B

ECI
N/A
Google DeepMind
Oct. 23, 2019
Open weights

T5-3B is an open-weights model from Google DeepMind, released October 23, 2019.

T5-3B vs select alternatives

DomainBenchmark
T5-3B
Google DeepMind
Oct. 23, 2019
Open weights
Language understanding
CommonSenseQA 2Best score 68%
60%
SuperGLUEBest score 89%
86%
BoolQBest score 91%
90%

Model metadata

General
OrganizationGoogle DeepMind
Release dateOct. 23, 2019
Model accessibilityOpen weights
CountryUnited States of America
Knowledge cutoffUnknown
Provider notesExploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Pricing
Input price—
Output price—
Training
Parameters2.8e9
Training compute9.0e21 FLOP
Training hardwareGoogle TPU v3
Training timeUnknown
Training dataset size5.1e9 datapoints