{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"116baf81-0f5f-56a9-b5c2-9960c03a3579","task_key":"ARC~2dEasy--test--TIMSS~5f1995~5f8~5fL7","task_revision_id":"1","upstream_id":"TIMSS_1995_8_L7","short_description":"The crews of two boats at sea can communicate with each other by shouting. Why…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['The sound is reflected more in space.', 'The pressure is too high inside the spaceships.', 'The spaceships are traveling faster than sound.', 'There is no air in space for the sound to travel through.']\",\"question\":\"The crews of two boats at sea can communicate with each other by shouting. Why is it impossible for the crews of two spaceships a similar distance apart in space to do this?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}