MPT-7B
ECI#232
74MPT-7B is an open-weights model from MosaicML, released May 5, 2023. It has an ECI score of 74 and ranks 232nd of 240 tracked models. At the time of its release, it ranked 6th of 9 tracked models.
MPT-7B vs select alternatives
| Domain | Benchmark | MPT-7B | |||
|---|---|---|---|---|---|
ECI scoreBest score 173 | 74 | 73 | 71 | 56 | |
| Ranking | #232 | #233 | #235 | #239 | |
| Conceptual reasoning | BBHBest score 89% | ||||
| Language understanding | LAMBADABest score 87% | ||||
PIQABest score 89% | |||||
BoolQBest score 91% | |||||
HellaSwagBest score 95% | |||||
| Mathematics | GSM8KBest score 95% | ||||
| Science | OpenBookQABest score 88% | ||||
ARC AI2Best score 95% | |||||
| World knowledge | MMLUBest score 88% |
