{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-challenge","formal_name":"ARC-Challenge","introduction":"ARC-Challenge is the subset of grade-school science questions that both a retrieval baseline and a word co-occurrence baseline answered incorrectly. It tests reasoning with knowledge rather than recall alone.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8ae116f7-0922-5da7-acfe-a74869f27b25","task_key":"ARC~2dChallenge--test--NAEP~5f2005~5f4~5fS14~2b3","task_revision_id":"1","upstream_id":"NAEP_2005_4_S14+3","short_description":"Pat has two kinds of plant food,\"\"Quickgrow\"\" and \"\"Supergrow.\"\" What would be…","config":"ARC-Challenge","split":"test","body":"{\"choices\":\"['Put some Quickgrow on a plant in the living room, put some Supergrow on a plant of the same type in the bedroom, and see which one grows the most.', 'Find out how much each kind of plant food costs, because the more expensive kind is probably better for growing plants.', 'Put some Quickgrow on a few plants, put the same amount of Supergrow on a few other plants of the same type, put all the plants in the same place, and see which group of plants grows the most.', 'Look at the advertisements for Quickgrow, look at the advertisements for Supergrow, and see which one says it helps plants grow the most.']\",\"question\":\"Pat has two kinds of plant food,\\\"\\\"Quickgrow\\\"\\\" and \\\"\\\"Supergrow.\\\"\\\" What would be the best way for Pat to find out which plant food helps a particular type of houseplant grow the most?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}