Gemma 3 27B
ECI#161
130Gemma 3 27B is an open-weights model from Google DeepMind, released March 12, 2025. It has an ECI score of 130 and ranks 161st of 260 tracked models. At the time of its release, it ranked 21st of 117 tracked models.
Gemma 3 27B vs select alternatives
| Domain | Benchmark | Gemma 3 27B | |||
|---|---|---|---|---|---|
ECI scoreBest score 167 | 130 | 129 | 132 | 130 | |
| Ranking | #161 | #165 | #157 | #163 | |
| Conceptual reasoning | LMCABest score 68.3 | 12.3 | — | — | 12.0 |
DTBenchBest score 99% | |||||
| Long context | Fiction.liveBenchBest score 97% | ||||
| Mathematics | MATH Level 5Best score 98% | ||||
OTIS Mock AIME 2024-2025Best score 100% | |||||
| Multimodal | GeoBenchBest score 88% | ||||
| Science | CritPtBest score 32% | ||||
SciCodeBest score 67% | |||||
GPQA DiamondBest score 96% |
