{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"56d6b3b9-57ed-5ca3-9a92-c0296842f3cc","task_key":"ARC~2dEasy--test--Mercury~5f410593","task_revision_id":"1","upstream_id":"Mercury_410593","short_description":"The structures in the bodies of many organisms have levels of organization that…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['tissue, cell, organ, organ system', 'organ, cell, organ system, tissue', 'cell, tissue, organ, organ system', 'organ system, tissue, organ, cell']\",\"question\":\"The structures in the bodies of many organisms have levels of organization that help the body to carry out life processes. Which list correctly shows how these levels are organized from the simplest to the most complex?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}