{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8274c445-aa76-52bf-a735-4df1cd7bdb60","task_key":"ARC~2dEasy--test--Mercury~5f7201268","task_revision_id":"1","upstream_id":"Mercury_7201268","short_description":"The European starling entered North America in the late 1800s. It proved very…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['its decomposers', 'its competitors', 'its mutualists', 'its predators']\",\"question\":\"The European starling entered North America in the late 1800s. It proved very successful and was able to spread throughout the United States by 1955. The survival and rapid reproduction of starlings most likely limited the population size of which organisms within its habitats?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}