Gemini 2.0 Flash (Dec 2024) is a closed-weights model from Google DeepMind, released December 11, 2024. It has an ECI score of 135 and ranks 136th of 249 tracked models. At the time of its release, it ranked 3rd of 98 tracked models.
| Domain | Benchmark | ||||
|---|---|---|---|---|---|
ECI scoreBest score 166 | 135 | 132 | 136 | 134 | |
| Ranking | #136 | #146 | #130 | #140 | |
| Conceptual reasoning | SimpleBenchBest score 81.9% | ||||
| Software engineering | Aider PolyglotBest score 88.0% | ||||
| World knowledge | MMLUBest score 88.1% | ||||
| Writing & creativity | Lech Mazur WritingBest score 8.6 | 7.2 | — | 6.5 | 8.0 |
| Other | LiveBenchBest score 82.3% |