{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4242637e-9c2b-5de0-8e3b-3848f17b5d95","task_key":"ARC~2dEasy--test--Mercury~5fSC~5f414087","task_revision_id":"1","upstream_id":"Mercury_SC_414087","short_description":"Some pea plants always have peas with smooth skin. Other pea plants always have…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['by checking the amount of water in the soil', 'by checking how often the pea plant receives sunlight', 'by checking how much space the plant will have to grow', 'by checking the type of peas growing on the parent plants']\",\"question\":\"Some pea plants always have peas with smooth skin. Other pea plants always have peas with wrinkled skin. How can a student best predict which kind of pea will grow from a seed that is planted?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}