StarCoder 2 15B
ECI#217
96StarCoder 2 15B is an open-weights model from Hugging Face, ServiceNow, Nvidia, and BigCode, released February 20, 2024. It has an ECI score of 96 and ranks 217th of 240 tracked models. At the time of its release, it ranked 19th of 38 tracked models.
StarCoder 2 15B vs select alternatives
| Domain | Benchmark | StarCoder 2 15B | |||
|---|---|---|---|---|---|
ECI scoreBest score 173 | 96 | 103 | 109 | 118 | |
| Ranking | #217 | #208 | #203 | #190 | |
| Language understanding | WinoGrandeBest score 89% | ||||
| Mathematics | GSM8KBest score 95% | ||||
| Science | ARC AI2Best score 95% | ||||
| World knowledge | MMLUBest score 88% |
