Back to models

Nemotron-4 15B

ECI#213
99
Nvidia
Feb. 26, 2024
Closed weights

Nemotron-4 15B is a closed-weights model from Nvidia, released February 26, 2024. It has an ECI score of 99 and ranks 213th of 240 tracked models. At the time of its release, it ranked 18th of 43 tracked models.

Nemotron-4 15B vs select alternatives

DomainBenchmark
Nemotron-4 15B
Nvidia
Feb. 26, 2024
Closed weights
StarCoder 2 15B
Hugging Face
Feb. 20, 2024
Open weights
Gemma 7B
Google DeepMind
Feb. 21, 2024
Open weights
Llama 3-8B
Meta AI
Apr. 18, 2024
Open weights
ECI scoreBest score 173
9996103109
Ranking#213#217#208#203
Conceptual reasoning
BBHBest score 89%
59%
n/a
55%
n/a
Language understanding
PIQABest score 89%
82%
n/a
81%
n/a
WinoGrandeBest score 89%
78%
64%
79%
76%
HellaSwagBest score 95%
82%
n/a
82%
n/a
Mathematics
GSM8KBest score 95%
46%
58%
46%
n/a
Science
ARC AI2Best score 95%
56%
47%
78%
83%
World knowledge
MMLUBest score 88%
59%
64%
66%
69%

Model metadata

General
OrganizationNvidia
Release dateFeb. 26, 2024
Model accessibilityClosed weights
CountryUnited States of America
Knowledge cutoffUnknown
Provider notesNemotron-4 15B Technical Report
Pricing
Input price—
Output price—
Training
Parameters1.5e10
Training compute7.5e23 FLOP
Training hardwareNVIDIA H100 SXM5 80GB
Training time13 days
Training dataset sizeUnknown