Back to models

Claude Instant

ECI#188
120
Anthropic
Aug. 9, 2023
Closed weights

Claude Instant is a closed-weights model from Anthropic, released August 9, 2023. It has an ECI score of 120 and ranks 188th of 249 tracked models. At the time of its release, it ranked 3rd of 22 tracked models. At $0.80/Mtok for input tokens and $2.40/Mtok for output tokens, it is less expensive per token than similarly-capable models.

Input price$0.80 / 1M tokens
Output price$2.40 / 1M tokens
ParametersUnknown
Training computeUnknown

Claude Instant vs select alternatives

Reasoning
DomainBenchmark
Claude Instant
Anthropic
Aug. 9, 2023
Closed weights
Claude 2
Anthropic
Jul. 11, 2023
Closed weights
GPT-4 (Mar 2023)
OpenAI
Mar. 14, 2023
Closed weights
Stable Beluga 2
Stability AI
Jul. 20, 2023
Open weights
ECI scoreBest score 166
120120126117
Ranking#188#189#173#202
Conceptual reasoning
DTBenchBest score 98.4%
45.8%
51.9%
n/a
n/a
Mathematics
GSM8KBest score 94.5%
86.7%
n/a
92.0%
69.6%
Science
ARC AI2Best score 95.3%
86.3%
n/a
n/a
86.1%
World knowledge
TriviaQABest score 87.5%
78.9%
87.5%
n/a
n/a
MMLUBest score 88.1%
73.4%
78.5%
86.4%
68.6%

Model metadata

General
OrganizationAnthropic
Release dateAug. 9, 2023
Model accessibilityClosed weights
CountryUnited States of America
Knowledge cutoff2023-01-01
Provider notesReleasing Claude Instant 1.2
Pricing
Input price$0.80 / 1M tokens
Output price$2.40 / 1M tokens
Training
ParametersUnknown
Training computeUnknown
Training hardwareUnknown
Training timeUnknown
Training dataset sizeUnknown