{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"80e9e8a5-ac67-5274-b5f1-4e2f3e9a581a","task_key":"ARC~2dEasy--test--MEAP~5f2005~5f8~5f15","task_revision_id":"1","upstream_id":"MEAP_2005_8_15","short_description":"When rain falls on the land, some of it is absorbed by surface sediment. How…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['flooding', 'droughts', 'tornadoes', 'spring formation']\",\"question\":\"When rain falls on the land, some of it is absorbed by surface sediment. How porous the surface sediments are controls how much water is absorbed. Which of the following will most likely result in an area where surface sediment is NOT porous?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}