{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5ddf2064-51e7-5c7b-bdb5-8ed8d0fc353d","task_key":"ARC~2dEasy--test--Mercury~5fSC~5f406480","task_revision_id":"1","upstream_id":"Mercury_SC_406480","short_description":"A student must explain the role of dead leaves in the ecosystem. Which statement…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['The leaves provide shelter to growing seeds.', 'The decay of the leaves provides nutrients to other plants.', 'The leaves release chlorophyll into the grass as they decay.', 'The leaves prevent fungus from growing at the base of the tree.']\",\"question\":\"A student must explain the role of dead leaves in the ecosystem. Which statement will the student most likely provide to explain the importance of these leaves?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}