{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"23a44c4a-5f06-5251-8ff3-af976684995b","task_key":"ARC~2dEasy--test--Mercury~5fSC~5f415583","task_revision_id":"1","upstream_id":"Mercury_SC_415583","short_description":"In a turtle race, each turtle walks one a 3-meter track. If the turtles walk one…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['The turtle that started first is fastest.', 'The turtle that finished first is fastest.', 'The turtle that took the shortest time is fastest.', 'The turtle that took the longest time is fastest.']\",\"question\":\"In a turtle race, each turtle walks one a 3-meter track. If the turtles walk one at a time, how can you tell which turtle was fastest?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}