Back to models

Gemma 2 9B

ECI#190
120
Google DeepMind
Jun. 24, 2024
Open weights

Gemma 2 9B is an open-weights model from Google DeepMind, released June 24, 2024. It has an ECI score of 120 and ranks 190th of 249 tracked models. At the time of its release, it ranked 21st of 69 tracked models.

Gemma 2 9B vs select alternatives

DomainBenchmark
Gemma 2 9B
Google DeepMind
Jun. 24, 2024
Open weights
Gemini 1.0 Pro
Google DeepMind
Dec. 13, 2023
Closed weights
Gemini 1.5 Flash (May 2024)
Google DeepMind
May 23, 2024
Closed weights
Mistral NeMo
Mistral AI
Jul. 18, 2024
Open weights
ECI scoreBest score 166
120117123119
Ranking#190#203#181#194
Language understanding
PIQABest score 89%
84%
n/a
n/a
84%
BoolQBest score 91%
86%
n/a
86%
83%
Mathematics
GSM8KBest score 95%
85%
n/a
82%
84%
MATH Level 5Best score 98%
21%
11%
25%
11%
OTIS Mock AIME 2024-2025Best score 100%
1%
1%
4%
n/a
Science
GPQA DiamondBest score 96%
27%
34%
40%
30%
World knowledge
MMLUBest score 88%
72%
70%
78%
n/a

Model metadata

General
OrganizationGoogle DeepMind
Release dateJun. 24, 2024
Model accessibilityOpen weights
CountryUnited States of America
Knowledge cutoffUnknown
Provider notesGemma 2 offers best-in-class performance, runs at incredible speed across different hardware and easily integrates with other AI tools.
Pricing
Input price$0.03 / 1M tokens
Output price$0.09 / 1M tokens
Training
Parameters9.0e9
Training compute4.3e23 FLOP
Training hardwareGoogle TPU v4
Training timeUnknown
Training dataset size8.0e12 datapoints