{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-challenge","formal_name":"ARC-Challenge","introduction":"ARC-Challenge is the subset of grade-school science questions that both a retrieval baseline and a word co-occurrence baseline answered incorrectly. It tests reasoning with knowledge rather than recall alone.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"54800a99-901d-5a05-8a37-c2271898c33a","task_key":"ARC~2dChallenge--test--Mercury~5f7182210","task_revision_id":"1","upstream_id":"Mercury_7182210","short_description":"Tide pools are habitats for several kinds of organisms that attach to the rocky…","config":"ARC-Challenge","split":"test","body":"{\"choices\":\"['Diversity will increase as the rate of predation decreases.', 'Diversity will decrease as competition for space increases.', 'Diversity will increase as the recycling of nutrients decreases.', 'Diversity will decrease as food and oxygen supplies increase.']\",\"question\":\"Tide pools are habitats for several kinds of organisms that attach to the rocky surface and depend upon tides for food and oxygen. Sea stars present in these tide pools feed on mussels and other shellfish that have no other natural predators. How will it most likely impact species diversity if all of the sea stars are removed from the tide pool ecosystem?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}