{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d828d8f5-93fa-55e5-947a-b328f8a72ddf","task_key":"ARC~2dEasy--test--MSA~5f2013~5f5~5f5","task_revision_id":"1","upstream_id":"MSA_2013_5_5","short_description":"Pollutants, such as motor oil and gasoline, are sometimes leaked onto roads by…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['Storms wash the pollutants into lakes and rivers.', 'Animals become sick from licking the pollutants on the road.', 'Animals get stuck in the pollutants when they cross the road.', 'Winds blow the pollutants to the side of the road and harm the soil.']\",\"question\":\"Pollutants, such as motor oil and gasoline, are sometimes leaked onto roads by vehicles. How do these pollutants most likely affect the environment?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}