Back to models

Gemini 2.0 Flash (Dec 2024)

ECI#140
135
Google DeepMind
Dec. 11, 2024
Closed weights

Gemini 2.0 Flash (Dec 2024) is a closed-weights model from Google DeepMind, released December 11, 2024. It has an ECI score of 135 and ranks 140th of 253 tracked models. At the time of its release, it ranked 3rd of 98 tracked models.

Gemini 2.0 Flash (Dec 2024) vs select alternatives

DomainBenchmark
Gemini 2.0 Flash (Dec 2024)
Google DeepMind
Dec. 11, 2024
Closed weights
Google DeepMind
Sep. 24, 2024
Closed weights
OpenAI
Sep. 12, 2024
Closed weights
Anthropic
Oct. 22, 2024
Closed weights
ECI scoreBest score 167
135132136134
Ranking#140#150#134#144
Conceptual reasoning
SimpleBenchBest score 82%
31%
27%
18%
41%
Software engineering
Aider PolyglotBest score 88%
38%
n/a
33%
52%
World knowledge
MMLUBest score 88%
80%
87%
n/a
87%
Writing & creativity
Lech Mazur WritingBest score 8.6
7.2—6.58.0
Other
LiveBenchBest score 82%
64%
n/a
58%
59%

Model metadata