{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e700bb1c-9c50-51d9-9e6f-23db405473e9","task_key":"ARC~2dEasy--test--TAKS~5f2009~5f8~5f11","task_revision_id":"1","upstream_id":"TAKS_2009_8_11","short_description":"When a butterfly emerges from its chrysalis, its wings are crumpled. In order to…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['increasing the pressure inside the wings', 'decreasing the density of the wings', 'increasing the temperature inside the wings', 'decreasing the mass of the wings']\",\"question\":\"When a butterfly emerges from its chrysalis, its wings are crumpled. In order to expand its wings, the butterfly hangs upside down, causing fluid to be pumped into the veins of its wings. This pumping most likely expands the wings by\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}