{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-challenge","formal_name":"ARC-Challenge","introduction":"ARC-Challenge is the subset of grade-school science questions that both a retrieval baseline and a word co-occurrence baseline answered incorrectly. It tests reasoning with knowledge rather than recall alone.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"56626ddb-23c1-5ade-8196-9c58b23f29e3","task_key":"ARC~2dChallenge--test--Mercury~5f7222460","task_revision_id":"1","upstream_id":"Mercury_7222460","short_description":"In 1879, Marie Cornu discovered that light from the Sun had a drop in…","config":"ARC-Challenge","split":"test","body":"{\"choices\":\"['inquiring into the causes of observed phenomena', 'finding options for replacing missing wavelengths of light', 'health concerns about the effects of ultraviolet radiation', 'predicting future changes in ultraviolet light output']\",\"question\":\"In 1879, Marie Cornu discovered that light from the Sun had a drop in ultraviolet (UV) light. Two years later, Walter Hartley found that ozone absorbs certain wavelengths of UV light. What motivated Charles Fabry and Henri Buisson to conduct research that led to the discovery of the ozone layer in the atmosphere of Earth?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}