{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"89118721-848b-502c-aeab-97ac6ec9b92d","task_key":"ARC~2dEasy--test--TIMSS~5f1995~5f8~5fL3","task_revision_id":"1","upstream_id":"TIMSS_1995_8_L3","short_description":"A girl found the skull of an animal. She did not know what the animal was but…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['The eye sockets faced sideways.', 'The skull was much longer than it was wide.', 'There was a projecting ridge along the top of the skull.', 'Four of the teeth were long and pointed.', 'The jaws could move sideways as well as up and down.']\",\"question\":\"A girl found the skull of an animal. She did not know what the animal was but she was sure that it preyed on other animals for its food. What clue led to this conclusion?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}