Back to models

Gemini 1.0 Pro

ECI#208
117
Google DeepMind
Dec. 13, 2023
Closed weights

Gemini 1.0 Pro is a closed-weights model from Google DeepMind, released December 13, 2023. It has an ECI score of 117 and ranks 208th of 253 tracked models. At the time of its release, it ranked 9th of 39 tracked models.

Gemini 1.0 Pro vs select alternatives

DomainBenchmark
Gemini 1.0 Pro
Google DeepMind
Dec. 13, 2023
Closed weights
Yi-34B
01.AI
Nov. 2, 2023
Open weights
Mixtral 8x7B
Mistral AI
Dec. 11, 2023
Open weights
GPT-3.5 Turbo (Nov 2023)
OpenAI
Nov. 6, 2023
Closed weights
ECI scoreBest score 169
117117118119
Ranking#208#206#204#203
Conceptual reasoning
DTBenchBest score 99%
46%
n/a
50%
n/a
Mathematics
MATH Level 5Best score 98%
11%
5%
10%
16%
Science
GPQA DiamondBest score 96%
34%
15%
31%
28%
World knowledge
MMLUBest score 88%
70%
76%
71%
71%

Model metadata

General
OrganizationGoogle DeepMind
Release dateDec. 13, 2023
Model accessibilityClosed weights
CountryUnited States of America
Knowledge cutoff2024-02-01
Provider notesGemini: A Family of Highly Capable Multimodal Models
Pricing
Input price—
Output price—
Training
ParametersUnknown
Training computeUnknown
Training hardwareGoogle TPU v4
Training timeUnknown
Training dataset sizeUnknown