Gemini 1.5 Flash (May 2024)
ECI#181
123Gemini 1.5 Flash (May 2024) is a closed-weights model from Google DeepMind, released May 23, 2024. It has an ECI score of 123 and ranks 181st of 249 tracked models. At the time of its release, it ranked 10th of 64 tracked models.
Input price—
Output price—
ParametersUnknown
Training computeUnknown
Gemini 1.5 Flash (May 2024) vs select alternatives
Reasoning
| Domain | Benchmark | Gemini 1.5 Flash (May 2024) | |||
|---|---|---|---|---|---|
ECI scoreBest score 166 | 123 | 117 | 127 | 123 | |
| Ranking | #181 | #203 | #169 | #180 | |
| Conceptual reasoning | DTBenchBest score 98.4% | ||||
| Long context | ForecastBenchBest score 62.5 | 53.9 | — | 58.5 | 57.1 |
| Mathematics | MATH Level 5Best score 98.1% | ||||
OTIS Mock AIME 2024-2025Best score 100.0% | |||||
| Multimodal | Video-MMEBest score 79.7% | ||||
| Science | GPQA DiamondBest score 95.8% | ||||
| World knowledge | MMLUBest score 88.1% |
