{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-challenge","formal_name":"ARC-Challenge","introduction":"ARC-Challenge is the subset of grade-school science questions that both a retrieval baseline and a word co-occurrence baseline answered incorrectly. It tests reasoning with knowledge rather than recall alone.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"205083a1-e92e-54fc-8ec2-c1032c15a20b","task_key":"ARC~2dChallenge--test--Mercury~5f7133613","task_revision_id":"1","upstream_id":"Mercury_7133613","short_description":"The cactus moth was deliberately introduced to Australia in 1926 as a biological…","config":"ARC-Challenge","split":"test","body":"{\"choices\":\"['Release sterile moths to limit reproduction.', 'Use widespread spraying of insecticides.', 'Introduce a predator of the cacti.', 'Stop importation of all types of plants.']\",\"question\":\"The cactus moth was deliberately introduced to Australia in 1926 as a biological control for an invasive prickly pear cactus. By the early 1990s the moth had also migrated to the Florida Keys from South America and the moth soon eliminated most of the semaphore cacti in the region. Since then, the moth has adapted to eat other plants in the Keys and has continued to grow in number. Which procedure would most likely reduce the population of the cactus moth?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}