{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5982fe7d-7e6d-5850-b0df-b5fedaf6e2aa","task_key":"ARC~2dEasy--test--Mercury~5fSC~5f408851","task_revision_id":"1","upstream_id":"Mercury_SC_408851","short_description":"The invention of the microscope was important to the advancement of science.…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['Matter is made of elements.', 'Plants can make their own food.', 'Some organisms have only one cell.', 'White light can be broken into colors.']\",\"question\":\"The invention of the microscope was important to the advancement of science. Many other discoveries were only possible with the help of the microscope. The microscope was used to make which discovery?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}