Back to models

Gemma 2 27B

ECI#188
122
Google DeepMind
Jun. 24, 2024
Open weights

Gemma 2 27B is an open-weights model from Google DeepMind, released June 24, 2024. It has an ECI score of 122 and ranks 188th of 253 tracked models. At the time of its release, it ranked 13th of 68 tracked models.

Gemma 2 27B vs select alternatives

DomainBenchmark
Gemma 2 27B
Google DeepMind
Jun. 24, 2024
Open weights
Gemini 1.0 Pro
Google DeepMind
Dec. 13, 2023
Closed weights
Gemini 1.5 Flash (May 2024)
Google DeepMind
May 23, 2024
Closed weights
Qwen2-72B
Alibaba
Jun. 7, 2024
Open weights
ECI scoreBest score 169
122117123125
Ranking#188#208#187#182
Conceptual reasoning
DTBenchBest score 99%
48%
46%
51%
n/a
Mathematics
MATH Level 5Best score 98%
28%
11%
25%
39%
OTIS Mock AIME 2024-2025Best score 100%
1%
1%
4%
n/a
Science
GPQA DiamondBest score 96%
36%
34%
40%
41%
World knowledge
MMLUBest score 88%
76%
70%
78%
82%

Model metadata

General
OrganizationGoogle DeepMind
Release dateJun. 24, 2024
Model accessibilityOpen weights
CountryUnited States of America
Knowledge cutoffUnknown
Provider notesGemma 2 offers best-in-class performance, runs at incredible speed across different hardware and easily integrates with other AI tools.
Pricing
Input price$0.65 / 1M tokens
Output price$0.65 / 1M tokens
Training
Parameters2.7e10
Training compute2.1e24 FLOP
Training hardwareGoogle TPU v5p
Training timeUnknown
Training dataset size1.3e13 datapoints