Back to models

Claude Instant

ECI#192
120
Anthropic
Aug. 9, 2023
Closed weights

Claude Instant is a closed-weights model from Anthropic, released August 9, 2023. It has an ECI score of 120 and ranks 192nd of 253 tracked models. At the time of its release, it ranked 3rd of 22 tracked models.

Claude Instant vs select alternatives

DomainBenchmark
Claude Instant
Anthropic
Aug. 9, 2023
Closed weights
Anthropic
Jul. 11, 2023
Closed weights
OpenAI
Mar. 14, 2023
Closed weights
Stability AI
Jul. 20, 2023
Open weights
ECI scoreBest score 167
120120126117
Ranking#192#193#177#206
Conceptual reasoning
DTBenchBest score 99%
46%
52%
n/a
n/a
Mathematics
GSM8KBest score 95%
87%
n/a
92%
70%
Science
ARC AI2Best score 95%
86%
n/a
n/a
86%
World knowledge
TriviaQABest score 88%
79%
88%
n/a
n/a
MMLUBest score 88%
73%
79%
86%
69%

Model metadata