GPT-3.5 Turbo (Nov 2023) is a closed-weights model from OpenAI, released November 6, 2023. It has an ECI score of 118 and ranks 195th of 249 tracked models. At the time of its release, it ranked 5th of 34 tracked models. At $1/Mtok for input tokens and $2/Mtok for output tokens, it is more expensive per token than similarly-capable models.
| Domain | Benchmark | ||||
|---|---|---|---|---|---|
ECI scoreBest score 166 | 118 | 126 | 120 | 117 | |
| Ranking | #195 | #173 | #188 | #200 | |
| Language understanding | WinoGrandeBest score 89.2% | ||||
| Mathematics | MATH Level 5Best score 98.1% | ||||
| Science | ARC AI2Best score 95.3% | ||||
GPQA DiamondBest score 95.8% | |||||
| World knowledge | TriviaQABest score 87.5% | ||||
MMLUBest score 88.1% |