{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ed91ea0b-0ba7-51ea-8ae3-331252c774a3","task_key":"ARC~2dEasy--test--Mercury~5f7211628","task_revision_id":"1","upstream_id":"Mercury_7211628","short_description":"Approximately 14,000 years ago, the climate in North America began to warm…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['a reduction in the rate of species change', 'an increase in the rate of large mammal extinctions', 'an increase in the amount of interspecies cooperation', 'a reduction in the total number of small parasitic insects']\",\"question\":\"Approximately 14,000 years ago, the climate in North America began to warm rapidly. At the same time, human hunters migrated to the continent. Which of these most likely resulted from a combination of these two factors?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}