{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a1436d7f-8d45-5b85-a8f9-68a256216c2f","task_key":"ARC~2dEasy--test--MSA~5f2012~5f8~5f34","task_revision_id":"1","upstream_id":"MSA_2012_8_34","short_description":"Sodium (Na) and chlorine (Cl) are two reactive and dangerous elements. Chlorine…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['The properties of both sodium and chlorine change.', 'The properties of both sodium and chlorine remain the same.', 'The properties of sodium are different but chlorine remains a dangerous gas.', 'The properties of sodium remain the same but the properties of chlorine change.']\",\"question\":\"Sodium (Na) and chlorine (Cl) are two reactive and dangerous elements. Chlorine is a halogen gas that can cause respiratory damage and sodium is an alkali metal that reacts violently with water. What happens to the properties of sodium and chlorine when they react to form sodium chloride (NaCl), common table salt?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}