Back to models

Nemotron-4 15B

ECI#225
107
Nvidia
Feb. 26, 2024
Closed weights

Nemotron-4 15B is a closed-weights model from Nvidia, released February 26, 2024. It has an ECI score of 107 and ranks 225th of 253 tracked models. At the time of its release, it ranked 22nd of 48 tracked models.

Nemotron-4 15B vs select alternatives

DomainBenchmark
Nemotron-4 15B
Nvidia
Feb. 26, 2024
Closed weights
StarCoder 2 15B
Hugging Face
Feb. 20, 2024
Open weights
Gemma 7B
Google DeepMind
Feb. 21, 2024
Open weights
Llama 3-8B
Meta AI
Apr. 18, 2024
Open weights
ECI scoreBest score 169
107105112116
Ranking#225#230#220#211
Conceptual reasoning
BBHBest score 89%
59%
n/a
55%
n/a
Language understanding
PIQABest score 89%
82%
n/a
81%
n/a
WinoGrandeBest score 89%
78%
64%
79%
76%
HellaSwagBest score 95%
82%
n/a
82%
n/a
Mathematics
GSM8KBest score 95%
46%
58%
46%
n/a
Science
ARC AI2Best score 95%
56%
47%
78%
83%
World knowledge
MMLUBest score 88%
59%
64%
66%
69%

Model metadata

General
OrganizationNvidia
Release dateFeb. 26, 2024
Model accessibilityClosed weights
CountryUnited States of America
Knowledge cutoffUnknown
Provider notesNemotron-4 15B Technical Report
Pricing
Input price—
Output price—
Training
Parameters1.5e10
Training compute7.5e23 FLOP
Training hardwareNVIDIA H100 SXM5 80GB
Training time13 days
Training dataset sizeUnknown