{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-challenge","formal_name":"ARC-Challenge","introduction":"ARC-Challenge is the subset of grade-school science questions that both a retrieval baseline and a word co-occurrence baseline answered incorrectly. It tests reasoning with knowledge rather than recall alone.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8abff0a5-2bed-5ca4-a571-f5107eb4280a","task_key":"ARC~2dChallenge--test--Mercury~5f7182245","task_revision_id":"1","upstream_id":"Mercury_7182245","short_description":"In a forested region, mountain lions and wolves prey upon the deer population to…","config":"ARC-Challenge","split":"test","body":"{\"choices\":\"['It will stabilize as the birth rate equals the death rate.', 'It will continue to increase steadily from year to year.', 'It will increase as other herbivores move into the region.', 'It will decrease due to overcrowding causing a food shortage.']\",\"question\":\"In a forested region, mountain lions and wolves prey upon the deer population to near disappearance. To protect the deer population, most of the mountain lions and wolves in this region were eliminated through hunting. As a result, over-hunting occurred and the deer population increased rapidly. After several years, what most likely will happen to the deer population in the absence of its predators?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}