{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e149fd0f-84e7-5150-b9f7-49f97065ba32","task_key":"ARC~2dEasy--test--LEAP~5f~5f8~5f10366","task_revision_id":"1","upstream_id":"LEAP__8_10366","short_description":"Over a long period, some flowering plants have become dependent on honey bees…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['grow taller so that the few remaining honey bees will find them.', 'change their flowers so that wind will fertilize them.', 'have always attracted many other insects as wells as honey bees.', 'have seeds that stay alive for a long time in the environment.']\",\"question\":\"Over a long period, some flowering plants have become dependent on honey bees for pollination. In recent years, a form of mite has infected and killed the honey bees in many areas of the country. Since this has happened, the once bee-dependent plants with the best chance of surviving are those that\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}