{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3c701094-8875-551e-b7a2-34025c49b6fd","task_key":"ARC~2dEasy--test--Mercury~5f7100643","task_revision_id":"1","upstream_id":"Mercury_7100643","short_description":"During the Siberian summer, reindeer graze on young roots, fungi, grass, and…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['return to their summer feeding area.', 'hibernate until the snows have stopped.', 'hunt for organisms such as small rodents.', 'move to other areas to compete for resources.']\",\"question\":\"During the Siberian summer, reindeer graze on young roots, fungi, grass, and other vegetation. In the cold winter months, they migrate south and rely on available, but less nutritious food, such as lichen. Increased snowfall during the entire winter in southern areas would result in reindeer having to\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}