Gemma 7B
ECI#216
112Gemma 7B is an open-weights model from Google DeepMind, released February 21, 2024. It has an ECI score of 112 and ranks 216th of 251 tracked models. At the time of its release, it ranked 18th of 46 tracked models.
Gemma 7B vs select alternatives
| Domain | Benchmark | Gemma 7B | |||
|---|---|---|---|---|---|
ECI scoreBest score 167 | 112 | 117 | 107 | 116 | |
| Ranking | #216 | #204 | #222 | #207 | |
| Conceptual reasoning | BBHBest score 89% | ||||
| Language understanding | Adversarial NLIBest score 58% | ||||
PIQABest score 89% | |||||
HellaSwagBest score 95% | |||||
| Mathematics | GSM8KBest score 95% | ||||
| Science | OpenBookQABest score 88% | ||||
ARC AI2Best score 95% | |||||
| World knowledge | TriviaQABest score 88% | ||||
MMLUBest score 88% |
