Gemma 3 4B is an open-weights model from Google DeepMind, released March 12, 2025. It has an ECI score of 116 and ranks 204th of 247 tracked models. At the time of its release, it ranked 74th of 117 tracked models. At $0.05/Mtok for input tokens and $0.10/Mtok for output tokens, it is less expensive per token than similarly-capable models.
| Domain | Benchmark | ||||
|---|---|---|---|---|---|
ECI scoreBest score 167 | 116 | 112 | 117 | 127 | |
| Ranking | #204 | #212 | #201 | #165 | |
| Conceptual reasoning | DTBenchBest score 98.4% | ||||
| Games | Chess PuzzlesBest score 72.0% | ||||
| Mathematics | OTIS Mock AIME 2024-2025Best score 100.0% | ||||
| Science | GPQA DiamondBest score 95.8% |