Gemma 3 27B
ECI#150
130Gemma 3 27B is an open-weights model from Google DeepMind, released March 12, 2025. It has an ECI score of 130 and ranks 150th of 249 tracked models. At the time of its release, it ranked 21st of 117 tracked models.
Gemma 3 27B vs select alternatives
| Domain | Benchmark | Gemma 3 27B | |||
|---|---|---|---|---|---|
ECI scoreBest score 166 | 130 | 129 | 132 | 130 | |
| Ranking | #150 | #154 | #146 | #152 | |
| Conceptual reasoning | LMCABest score 63.3 | 12.3 | — | — | 12.0 |
DTBenchBest score 98% | |||||
| Long context | Fiction.liveBenchBest score 97% | ||||
| Mathematics | MATH Level 5Best score 98% | ||||
OTIS Mock AIME 2024-2025Best score 100% | |||||
| Multimodal | GeoBenchBest score 88% | ||||
| Science | CritPtBest score 32% | ||||
SciCodeBest score 62% | |||||
GPQA DiamondBest score 96% |
