StarCoder 2 7B
ECI#249
94StarCoder 2 7B is an open-weights model from Hugging Face, ServiceNow, Nvidia, and BigCode, released February 20, 2024. It has an ECI score of 94 and ranks 249th of 257 tracked models. At the time of its release, it ranked 37th of 44 tracked models.
StarCoder 2 7B vs select alternatives
| Domain | Benchmark | StarCoder 2 7B | |||
|---|---|---|---|---|---|
ECI scoreBest score 167 | 94 | 94 | 116 | 118 | |
| Ranking | #249 | #248 | #213 | #206 | |
| Language understanding | WinoGrandeBest score 89% | ||||
| Mathematics | GSM8KBest score 95% | ||||
| Science | ARC AI2Best score 95% | ||||
| World knowledge | MMLUBest score 88% |
