Back to models

Gemini 1.0 Pro

ECI#207
117
Google DeepMind
Dec. 13, 2023
Closed weights

Gemini 1.0 Pro is a closed-weights model from Google DeepMind, released December 13, 2023. It has an ECI score of 117 and ranks 207th of 253 tracked models. At the time of its release, it ranked 10th of 40 tracked models.

Gemini 1.0 Pro vs select alternatives

DomainBenchmark
Gemini 1.0 Pro
Google DeepMind
Dec. 13, 2023
Closed weights
Yi-34B
01.AI
Nov. 2, 2023
Open weights
GPT-3.5 Turbo (Jan 2024)
OpenAI
Jan. 25, 2024
Closed weights
Mixtral 8x7B
Mistral AI
Dec. 11, 2023
Open weights
ECI scoreBest score 167
117117116118
Ranking#207#204#211#201
Conceptual reasoning
DTBenchBest score 99%
46%
n/a
49%
50%
Mathematics
MATH Level 5Best score 98%
11%
5%
12%
10%
OTIS Mock AIME 2024-2025Best score 100%
1%
n/a
2%
n/a
Science
GPQA DiamondBest score 96%
34%
15%
27%
31%
World knowledge
MMLUBest score 88%
70%
76%
67%
71%

Model metadata

General
OrganizationGoogle DeepMind
Release dateDec. 13, 2023
Model accessibilityClosed weights
CountryUnited States of America
Knowledge cutoff2024-02-01
Provider notesGemini: A Family of Highly Capable Multimodal Models
Pricing
Input price—
Output price—
Training
ParametersUnknown
Training computeUnknown
Training hardwareGoogle TPU v4
Training timeUnknown
Training dataset sizeUnknown