{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"04065c96-f6dc-55af-ba4f-96f75d270265","task_key":"ARC~2dEasy--test--ACTAAP~5f2010~5f7~5f16","task_revision_id":"1","upstream_id":"ACTAAP_2010_7_16","short_description":"If a species of bird stopped reproducing, which of these would happen?","config":"ARC-Easy","split":"test","body":"{\"choices\":\"[\\\"The bird's prey species would decrease in number.\\\", 'The food web that the bird belongs to would collapse.', 'Trees where these birds build nests would grow taller.', 'This bird species would eventually disappear from nature.']\",\"question\":\"If a species of bird stopped reproducing, which of these would happen?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}