{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f6985015-c977-55fc-9377-62336443452a","task_key":"ARC~2dEasy--test--MEAP~5f2005~5f8~5f31","task_revision_id":"1","upstream_id":"MEAP_2005_8_31","short_description":"When mining for coal, a mining company removes the plants and layers of soil and…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['prevent a collapse of the underlying sediment.', 'limit the types of pollutants that can enter the soil.', 'increase water absorption by the replaced sediments.', 'reduce soil erosion and provide new habitat for animals.']\",\"question\":\"When mining for coal, a mining company removes the plants and layers of soil and rock above the coal deposit, and takes the coal. When the operation is complete, the mining company returns soil and rock, covers it with a layer of topsoil, and plants trees and grass. The trees and grass help to\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}