Gemma 7B
ECI#208
103Gemma 7B is an open-weights model from Google DeepMind, released February 21, 2024. It has an ECI score of 103 and ranks 208th of 240 tracked models. At the time of its release, it ranked 13th of 40 tracked models.
Gemma 7B vs select alternatives
| Domain | Benchmark | Gemma 7B | ||
|---|---|---|---|---|
ECI scoreBest score 173 | 103 | 99 | 109 | |
| Ranking | #208 | #213 | #203 | |
| Conceptual reasoning | BBHBest score 89% | |||
| Language understanding | Adversarial NLIBest score 58% | |||
PIQABest score 89% | ||||
HellaSwagBest score 95% | ||||
| Mathematics | GSM8KBest score 95% | |||
| Science | OpenBookQABest score 88% | |||
ARC AI2Best score 95% | ||||
| World knowledge | TriviaQABest score 88% | |||
MMLUBest score 88% |
