{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-easy","formal_name":"ARC-Easy","introduction":"ARC-Easy is the subset of grade-school science questions that a retrieval baseline or a word co-occurrence baseline answered correctly. It is the easier counterpart of ARC-Challenge and serves as the baseline measure of science knowledge recall.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e4c2e93c-d121-52b9-9fe8-1da8808a58a3","task_key":"ARC~2dEasy--test--Mercury~5f7145215","task_revision_id":"1","upstream_id":"Mercury_7145215","short_description":"During the year, the angle at which the path of the Sun appears in the sky…","config":"ARC-Easy","split":"test","body":"{\"choices\":\"['the rotation of Earth', 'the tilted axis of Earth', 'the flattening of Earth at the poles', 'the elliptical shape of the orbit of Earth']\",\"question\":\"During the year, the angle at which the path of the Sun appears in the sky varies. In the Northern Hemisphere, the path of the Sun appears higher on the horizon during the summer and lower on the horizon during the winter. Which factor most contributes to the variation in the path of the Sun across the sky?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}