Back to models

Gemma 2 9B

ECI#196
113
Google DeepMind
Jun. 24, 2024
Open weights

Gemma 2 9B is an open-weights model from Google DeepMind, released June 24, 2024. It has an ECI score of 113 and ranks 196th of 237 tracked models. At the time of its release, it ranked 25th of 62 tracked models.

Gemma 2 9B vs select alternatives

DomainBenchmark
Gemma 2 9B
Google DeepMind
Jun. 24, 2024
Open weights
Gemma 7B
Google DeepMind
Feb. 21, 2024
Open weights
Gemini 1.5 Flash (May 2024)
Google DeepMind
May 23, 2024
Closed weights
Mistral NeMo
Mistral AI
Jul. 18, 2024
Open weights
ECI scoreBest score 169
113103121114
Ranking#196#205#180#192
Language understanding
PIQABest score 89%
84%
81%
n/a
84%
BoolQBest score 91%
86%
83%
86%
83%
Mathematics
GSM8KBest score 95%
85%
46%
82%
84%
MATH Level 5Best score 98%
21%
n/a
25%
11%
OTIS Mock AIME 2024-2025Best score 100%
1%
n/a
4%
n/a
Science
GPQA DiamondBest score 96%
27%
n/a
40%
30%
World knowledge
MMLUBest score 88%
72%
66%
78%
n/a

Model metadata

General
OrganizationGoogle DeepMind
Release dateJun. 24, 2024
Model accessibilityOpen weights
CountryUnited States of America
Knowledge cutoffUnknown
Provider notesGemma 2 offers best-in-class performance, runs at incredible speed across different hardware and easily integrates with other AI tools.
Pricing
Input price$0.03 / 1M tokens
Output price$0.09 / 1M tokens
Training
Parameters9.0e9
Training compute4.3e23 FLOP
Training hardwareGoogle TPU v4
Training timeUnknown
Training dataset size8.0e12 datapoints