Back to models

GPT-3.5 Turbo (Jan 2024)

ECI#211
116
OpenAI
Jan. 25, 2024
Closed weights

GPT-3.5 Turbo (Jan 2024) is a closed-weights model from OpenAI, released January 25, 2024. It has an ECI score of 116 and ranks 211th of 253 tracked models. At the time of its release, it ranked 12th of 42 tracked models.

GPT-3.5 Turbo (Jan 2024) vs select alternatives

DomainBenchmark
GPT-3.5 Turbo (Jan 2024)
OpenAI
Jan. 25, 2024
Closed weights
GPT-3.5 Turbo (Jun 2023)
OpenAI
Jun. 13, 2023
Closed weights
GPT-3.5 Turbo (Nov 2023)
OpenAI
Nov. 6, 2023
Closed weights
Claude 3 Haiku
Anthropic
Mar. 7, 2024
Closed weights
ECI scoreBest score 167
116113119118
Ranking#211#213#199#202
Conceptual reasoning
LMCABest score 68.2
9.7——8.8
DTBenchBest score 99%
49%
n/a
n/a
50%
Long context
ForecastBenchBest score 62.5
50.4——53.2
Mathematics
MATH Level 5Best score 98%
12%
n/a
16%
15%
OTIS Mock AIME 2024-2025Best score 100%
2%
n/a
n/a
2%
Science
GPQA DiamondBest score 96%
27%
n/a
28%
36%
Software engineering
WeirdML (v2)Best score 94%
3%
n/a
n/a
10%
World knowledge
MMLUBest score 88%
67%
69%
71%
74%

Model metadata

General
OrganizationOpenAI
Release dateJan. 25, 2024
Model accessibilityClosed weights
CountryUnited States of America
Knowledge cutoff2021-09-01
Provider notesA fast, inexpensive model for simple tasks
Pricing
Input price$0.50 / 1M tokens
Output price$1.50 / 1M tokens
Training
Parameters2.0e10
Training computeUnknown
Training hardwareUnknown
Training timeUnknown
Training dataset sizeUnknown