{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-challenge","formal_name":"ARC-Challenge","introduction":"ARC-Challenge is the subset of grade-school science questions that both a retrieval baseline and a word co-occurrence baseline answered incorrectly. It tests reasoning with knowledge rather than recall alone.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3a4ac4a3-6fd7-595c-8d8e-4f0ebe266a25","task_key":"ARC~2dChallenge--test--Mercury~5f7150343","task_revision_id":"1","upstream_id":"Mercury_7150343","short_description":"Energy from the Sun enters ecosystems through the transformation of light to…","config":"ARC-Challenge","split":"test","body":"{\"choices\":\"['Available energy increases as trophic levels increase.', 'Available energy decreases as trophic levels increase.', 'Primary consumers have the least energy available.', 'Tertiary consumers have the most energy available.']\",\"question\":\"Energy from the Sun enters ecosystems through the transformation of light to chemical energy. This energy is available to different organisms based on the trophic level in which the organisms exist. Which statement best describes the availability of energy for organisms in different trophic levels?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}