Back to models

Claude 3 Sonnet

ECI#193
121
Anthropic
Feb. 29, 2024
Closed weights

Claude 3 Sonnet is a closed-weights model from Anthropic, released February 29, 2024. It has an ECI score of 121 and ranks 193rd of 253 tracked models. At the time of its release, it ranked 6th of 50 tracked models.

Claude 3 Sonnet vs select alternatives

DomainBenchmark
Claude 3 Sonnet
Anthropic
Feb. 29, 2024
Closed weights
Claude Instant
Anthropic
Aug. 9, 2023
Closed weights
phi-3-medium 14B
Microsoft
Apr. 23, 2024
Open weights
Mixtral 8x22B
Mistral AI
Apr. 17, 2024
Open weights
ECI scoreBest score 169
121120121122
Ranking#193#194#192#190
Conceptual reasoning
DTBenchBest score 99%
54%
46%
n/a
55%
Language understanding
WinoGrandeBest score 89%
75%
n/a
82%
n/a
Mathematics
MATH Level 5Best score 98%
18%
n/a
18%
24%
Science
GPQA DiamondBest score 96%
41%
n/a
28%
34%
Software engineering
WeirdML (v2)Best score 94%
10%
n/a
n/a
3%
World knowledge
MMLUBest score 88%
76%
73%
78%
78%

Model metadata

General
OrganizationAnthropic
Release dateFeb. 29, 2024
Model accessibilityClosed weights
CountryUnited States of America
Knowledge cutoff2023-08-01
Provider notesThe Claude 3 Model Family: Opus, Sonnet, Haiku
Pricing
Input price$3 / 1M tokens
Output price$15 / 1M tokens
Training
ParametersUnknown
Training computeUnknown
Training hardwareUnknown
Training timeUnknown
Training dataset sizeUnknown