{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9ab959f2-9f89-5291-8d60-5485ed14040f","task_key":"ARC~2dEasy--test--MCAS~5f1999~5f8~5f32","task_revision_id":"1","upstream_id":"MCAS_1999_8_32","short_description":"When coal is burned to produce electricity, the electrical energy produced is…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['As coal is heated, some of the molecules move so fast that they are destroyed.', 'Some of the energy in coal is destroyed by the intense heat required to release its potential energy.', 'Some of the potential energy in coal is converted into forms of energy other than electricity.', 'The amount of potential energy in fuels is overestimated.']\",\"question\":\"When coal is burned to produce electricity, the electrical energy produced is less than the potential energy in the coal. Which best explains this observation?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}