Nemotron-4 15B
ECI#222
107Nemotron-4 15B is a closed-weights model from NVIDIA, released February 26, 2024. It has an ECI score of 107 and ranks 222nd of 251 tracked models. At the time of its release, it ranked 23rd of 49 tracked models.
Nemotron-4 15B vs select alternatives
| Domain | Benchmark | Nemotron-4 15B | |||
|---|---|---|---|---|---|
ECI scoreBest score 167 | 107 | 105 | 112 | 116 | |
| Ranking | #222 | #227 | #216 | #207 | |
| Conceptual reasoning | BBHBest score 89% | ||||
| Language understanding | PIQABest score 89% | ||||
WinoGrandeBest score 89% | |||||
HellaSwagBest score 95% | |||||
| Mathematics | GSM8KBest score 95% | ||||
| Science | ARC AI2Best score 95% | ||||
| World knowledge | MMLUBest score 88% |
