{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"03298101-777a-59cc-84f1-545a16dfc024","task_key":"ARC~2dEasy--test--Mercury~5f417589","task_revision_id":"1","upstream_id":"Mercury_417589","short_description":"Scientists think that the rise in global temperature during the last one hundred…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['What is the mechanism by which carbon dioxide heats Earth?', 'What is the source of most of the carbon dioxide in the atmosphere?', 'What is the source of the increase of carbon dioxide in the atmosphere?', 'What is the increase in the concentration of carbon dioxide in the atmosphere?']\",\"question\":\"Scientists think that the rise in global temperature during the last one hundred years is due to an increase of carbon dioxide in the atmosphere. Which question would best help scientists assess the claim that humans are responsible for the rising global temperature?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}