Back to models

Gemini 1.0 Pro

ECI#203
117
Google DeepMind
Dec. 13, 2023
Closed weights

Gemini 1.0 Pro is a closed-weights model from Google DeepMind, released December 13, 2023. It has an ECI score of 117 and ranks 203rd of 249 tracked models. At the time of its release, it ranked 10th of 40 tracked models.

Input price—
Output price—
ParametersUnknown
Training computeUnknown

Gemini 1.0 Pro vs select alternatives

Reasoning
DomainBenchmark
Gemini 1.0 Pro
Google DeepMind
Dec. 13, 2023
Closed weights
Yi-34B
01.AI
Nov. 2, 2023
Open weights
GPT-3.5 Turbo (Jan 2024)
OpenAI
Jan. 25, 2024
Closed weights
Mixtral 8x7B
Mistral AI
Dec. 11, 2023
Open weights
ECI scoreBest score 166
117117116118
Ranking#203#200#207#197
Conceptual reasoning
DTBenchBest score 98.4%
45.9%
n/a
48.5%
49.6%
Mathematics
MATH Level 5Best score 98.1%
11.2%
5.1%
11.6%
10.0%
OTIS Mock AIME 2024-2025Best score 100.0%
1.1%
n/a
2.2%
n/a
Science
GPQA DiamondBest score 95.8%
34.0%
14.7%
27.2%
30.6%
World knowledge
MMLUBest score 88.1%
70.0%
76.3%
67.3%
70.6%

Model metadata

General
OrganizationGoogle DeepMind
Release dateDec. 13, 2023
Model accessibilityClosed weights
CountryUnited States of America
Knowledge cutoff2024-02-01
Provider notesGemini: A Family of Highly Capable Multimodal Models
Pricing
Input price—
Output price—
Training
ParametersUnknown
Training computeUnknown
Training hardwareGoogle TPU v4
Training timeUnknown
Training dataset sizeUnknown