OpenBookQA
A small open-book science QA benchmark requiring the combination of a core fact with additional commonsense to answer 4-choice questions.
About OpenBookQA
OpenBookQA is built around a set of elementary science statements (the “open book”) and questions that cannot be answered by the core fact alone. Success often requires integrating the given fact with everyday knowledge or auxiliary information to rule out distractors.
Although modest in size, OpenBookQA rewards models that can bridge explicit and implicit knowledge—an ability central to robust science QA performance.