Yi-34B is an open-weights model from 01.AI, released November 2, 2023. It has an ECI score of 117 and ranks 200th of 249 tracked models. At the time of its release, it ranked 5th of 33 tracked models. At $0.72/Mtok for input tokens and $0.72/Mtok for output tokens, it is more expensive per token than similarly-capable models.
| Domain | Benchmark | ||||
|---|---|---|---|---|---|
ECI scoreBest score 166 | 117 | 126 | 120 | 117 | |
| Ranking | #200 | #173 | #188 | #202 | |
| Conceptual reasoning | BBHBest score 89.2% | ||||
| Mathematics | GSM8KBest score 94.5% | ||||
| Science | GPQA DiamondBest score 95.8% | ||||
| World knowledge | MMLUBest score 88.1% |