{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-challenge","formal_name":"ARC-Challenge","introduction":"ARC-Challenge is the subset of grade-school science questions that both a retrieval baseline and a word co-occurrence baseline answered incorrectly. It tests reasoning with knowledge rather than recall alone.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"93395c11-3e5b-56cd-9e95-3ad2aca12739","task_key":"ARC~2dChallenge--test--MDSA~5f2009~5f5~5f20","task_revision_id":"2","upstream_id":"MDSA_2009_5_20","short_description":"All natural resources on Earth are either renewable or nonrenewable. Whether a…","config":"ARC-Challenge","split":"test","body":"{\"choices\":\"['A group of people swims in a river.', 'A construction crew builds an iron bridge.', 'A farmer grows vegetables to sell at a local market.', 'A person bakes a cake with electricity produced by a hydroelectric power plant.']\",\"question\":\"All natural resources on Earth are either renewable or nonrenewable. Whether a resource is renewable or nonrenewable depends on how fast or slow the resource is replaced. If the resource is used faster than it is replaced, then the resource will, in time, disappear. Which activity shows the use of a nonrenewable natural resource?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}