{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"02b2dfb7-d2cb-58c4-b983-55e747cba081","task_key":"ARC~2dEasy--test--Mercury~5f7141418","task_revision_id":"1","upstream_id":"Mercury_7141418","short_description":"The house cat was believed to be tamed in ancient Egypt. In 2004, the remains of…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['Wildcats are not related to house cats.', 'Cats were domesticated earlier than originally thought.', 'Wildcats were not domesticated.', 'The period of Egyptian civilization was older than originally thought.']\",\"question\":\"The house cat was believed to be tamed in ancient Egypt. In 2004, the remains of an eight-month old cat buried with its owner were discovered on the Mediterranean island of Cyprus. The date of burial, however, came before Egyptian civilization. Which best explains the importance of the discovery?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}