Back to models

Gemini 2.0 Flash (Dec 2024)

ECI#147
135
Google DeepMind
Dec. 11, 2024
Closed weights

Gemini 2.0 Flash (Dec 2024) is a closed-weights model from Google DeepMind, released December 11, 2024. It has an ECI score of 135 and ranks 147th of 253 tracked models. At the time of its release, it ranked 2nd of 94 tracked models.

Gemini 2.0 Flash (Dec 2024) vs select alternatives

DomainBenchmark
Gemini 2.0 Flash (Dec 2024)
Google DeepMind
Dec. 11, 2024
Closed weights
Google DeepMind
Sep. 24, 2024
Closed weights
OpenAI
Sep. 12, 2024
Closed weights
Anthropic
Oct. 22, 2024
Closed weights
ECI scoreBest score 169
135132136133
Ranking#147#156#142#151
Conceptual reasoning
SimpleBenchBest score 82%
31%
27%
18%
41%
Software engineering
Aider PolyglotBest score 88%
38%
n/a
33%
52%
World knowledge
MMLUBest score 88%
80%
87%
n/a
87%
Writing & creativity
Lech Mazur WritingBest score 8.6
7.2—6.58.0
Other
LiveBenchBest score 82%
64%
n/a
58%
59%

Model metadata