{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b6c43ce8-c35f-5a15-b6a2-7ee02d7b50ec","task_key":"ARC~2dEasy--test--Mercury~5f7005128","task_revision_id":"1","upstream_id":"Mercury_7005128","short_description":"Before strip mining for coal, the topsoil in the area is removed and stored.…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['to prevent wind from weathering and eroding surface coal.', 'to prevent radioactive elements from polluting water sources.', 'to provide an environment for new coal formation.', 'to restore the area to a natural condition.']\",\"question\":\"Before strip mining for coal, the topsoil in the area is removed and stored. After mining operations are completed, the land is leveled and topsoil is replaced. The purpose of replacing topsoil is\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}