InstructGPT 175B is a closed-weights model from OpenAI, released January 27, 2022.
| Domain | Benchmark | |
|---|---|---|
| Language understanding | Adversarial NLIBest score 58.1% | |
CommonSenseQA 2Best score 67.8% | ||
LAMBADABest score 87.2% | ||
PIQABest score 88.7% | ||
BoolQBest score 91.2% | ||
HellaSwagBest score 95.3% | ||
| Science | OpenBookQABest score 88.0% | |
ScienceQABest score 88.5% | ||
ARC AI2Best score 95.3% | ||
| World knowledge | MMLUBest score 88.1% |