{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9ef4de67-c138-500d-a0aa-9518b221cc6f","task_key":"ARC~2dEasy--test--MCAS~5f2010~5f5~5f11995","task_revision_id":"1","upstream_id":"MCAS_2010_5_11995","short_description":"Corals are small marine organisms that live in groups and make hard outer…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['It makes the ocean water saltier.', 'It removes sand from the ocean floor.', 'It causes ocean waves to become stronger.', 'It creates a habitat for some ocean animals.']\",\"question\":\"Corals are small marine organisms that live in groups and make hard outer skeletons to protect their bodies. Over time, these outer skeletons can build up to make large coral reefs. Which of the following statements best describes one way the formation of a coral reef changes the ocean ecosystem?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}