Back to models

Claude 3.5 Haiku

ECI#173
125
Anthropic
Oct. 22, 2024
Closed weights

Claude 3.5 Haiku is a closed-weights model from Anthropic, released October 22, 2024. It has an ECI score of 125 and ranks 173rd of 239 tracked models. At the time of its release, it ranked 15th of 80 tracked models.

Claude 3.5 Haiku vs select alternatives

DomainBenchmark
Claude 3.5 Haiku
Anthropic
Oct. 22, 2024
Closed weights
Claude 3 Sonnet
Anthropic
Feb. 29, 2024
Closed weights
Claude 3 Opus
Anthropic
Feb. 29, 2024
Closed weights
Llama 3.3 70B
Meta AI
Dec. 6, 2024
Open weights
ECI scoreBest score 174
125120126126
Ranking#173#185#171#169
Conceptual reasoning
DTBenchBest score 99%
57%
54%
62%
59%
Games
BALROGBest score 68%
19%
n/a
n/a
23%
Mathematics
MATH Level 5Best score 98%
46%
18%
37%
42%
OTIS Mock AIME 2024-2025Best score 100%
4%
3%
5%
5%
Science
CritPt v1Best score 36%
0%
n/a
n/a
0%
SciCodeBest score 67%
27%
n/a
n/a
26%
GPQA DiamondBest score 96%
38%
41%
47%
47%
Software engineering
WeirdML (v2)Best score 94%
31%
10%
19%
14%
Other
LiveBenchBest score 82%
43%
n/a
49%
50%

Model metadata

General
OrganizationAnthropic
Release dateOct. 22, 2024
Model accessibilityClosed weights
CountryUnited States of America
Knowledge cutoff2024-07-01
Provider notesOur fastest model, delivering advanced coding, tool use, and reasoning at an accessible price
Pricing
Input price$0.80 / 1M tokens
Output price$4 / 1M tokens
Training
ParametersUnknown
Training computeUnknown
Training hardwareUnknown
Training timeUnknown
Training dataset sizeUnknown