Back to models

GPT-NeoX-20B

ECI
N/A
EleutherAI
Apr. 7, 2022
Open weights

GPT-NeoX-20B is an open-weights model from EleutherAI, released April 7, 2022.

GPT-NeoX-20B vs select alternatives

DomainBenchmark
GPT-NeoX-20B
EleutherAI
Apr. 7, 2022
Open weights
Language understanding
PIQABest score 89%
77%
WinoGrandeBest score 89%
66%
BoolQBest score 91%
65%
HellaSwagBest score 95%
71%
Science
OpenBookQABest score 88%
39%
ARC AI2Best score 95%
41%

Model metadata

General
OrganizationEleutherAI
Release dateApr. 7, 2022
Model accessibilityOpen weights
CountryUnited States of America
Knowledge cutoffUnknown
Provider notesGPT-NeoX-20B: An Open-Source Autoregressive Language Model
Pricing
Input price—
Output price—
Training
Parameters2.0e10
Training compute9.3e22 FLOP
Training hardwareNVIDIA A100 SXM4 40 GB
Training time90 days
Training dataset size3.4e11 datapoints