{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"aec2f21c-1d9c-5d63-b519-99912c178686","task_key":"ARC~2dEasy--test--Mercury~5fSC~5f405137","task_revision_id":"1","upstream_id":"Mercury_SC_405137","short_description":"The oil used today is made from the ancient remains of tiny sea creatures called…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['The Sun turned diatoms into oil after 10-20 years.', 'Diatoms are the original source of energy for oil.', 'The Sun is the original source of energy for oil.', 'Diatoms converted oil into energy.']\",\"question\":\"The oil used today is made from the ancient remains of tiny sea creatures called \\\"Diatoms.\\\" When they were alive, the Diatoms converted sunlight into stored energy. Based on this information, which of the following statements is true?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}