{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3eabe0e7-da82-55d1-862c-05cc81a5ac3d","task_key":"ARC~2dEasy--test--AKDE~26ED~5f2008~5f8~5f18","task_revision_id":"1","upstream_id":"AKDE&ED_2008_8_18","short_description":"The Sun heats the atmosphere of Earth unevenly. Which of the following is the…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['Convection in the atmosphere causes a change in air density, resulting in winds.', 'Conduction through the atmosphere causes evaporation to occur over oceans, resulting in rain.', 'Radiation from the Sun will reflect through the atmosphere back into space resulting in cooler evenings.', 'Radiation from the Sun will cause atmospheric moisture to collect over mountain ranges resulting in snowfall.']\",\"question\":\"The Sun heats the atmosphere of Earth unevenly. Which of the following is the most likely result of this uneven heating?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}