{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-challenge","formal_name":"ARC-Challenge","introduction":"ARC-Challenge is the subset of grade-school science questions that both a retrieval baseline and a word co-occurrence baseline answered incorrectly. It tests reasoning with knowledge rather than recall alone.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7e5e75dd-787d-5cfa-94ca-70315cdcb444","task_key":"ARC~2dChallenge--test--Mercury~5f401926","task_revision_id":"1","upstream_id":"Mercury_401926","short_description":"Giant sloths lived in the Americas and the Caribbean during the Ice Age. Most of…","config":"ARC-Challenge","split":"test","body":"{\"choices\":\"['disease', 'lack of food', 'climate change', 'humans as predators']\",\"question\":\"Giant sloths lived in the Americas and the Caribbean during the Ice Age. Most of these sloths disappeared around 10,000 years ago, at the end of the Ice Age. However, some remained on Caribbean islands until around 4,200 years ago. That means some of these sloths lived alongside humans. What is the most likely reason that these last giant sloths became extinct?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}