MPT-30B
ECI#236
100MPT-30B is an open-weights model from MosaicML, released June 22, 2023. It has an ECI score of 100 and ranks 236th of 253 tracked models. At the time of its release, it ranked 7th of 14 tracked models.
MPT-30B vs select alternatives
| Domain | Benchmark | MPT-30B | |||
|---|---|---|---|---|---|
ECI scoreBest score 169 | 100 | 94 | 99 | 104 | |
| Ranking | #236 | #243 | #238 | #232 | |
| Conceptual reasoning | BBHBest score 89% | ||||
| Language understanding | PIQABest score 89% | ||||
WinoGrandeBest score 89% | |||||
BoolQBest score 91% | |||||
| Mathematics | GSM8KBest score 95% | ||||
| Science | OpenBookQABest score 88% | ||||
ARC AI2Best score 95% | |||||
| World knowledge | TriviaQABest score 88% | ||||
MMLUBest score 88% |
