{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"arc-challenge","formal_name":"ARC-Challenge","introduction":"ARC-Challenge is the subset of grade-school science questions that both a retrieval baseline and a word co-occurrence baseline answered incorrectly. It tests reasoning with knowledge rather than recall alone.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/allenai/ai2_arc","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"17d2cff1-ec83-5a20-b5a3-d4595edeb950","task_key":"ARC~2dChallenge--test--MEAP~5f2005~5f5~5f12","task_revision_id":"1","upstream_id":"MEAP_2005_5_12","short_description":"A farmer has three large fields where he plans to grow grasses to harvest for…","config":"ARC-Challenge","split":"test","body":"{\"choices\":\"['Plant each field at one-year intervals.', 'Plant the grasses as close together as possible.', 'Plant all the fields at the same time, but with different types of grasses.', 'Plant warm-season grasses and cool-season grasses in each field at the same time.']\",\"question\":\"A farmer has three large fields where he plans to grow grasses to harvest for hay. Grasses should be harvested only after two years of growth. What could the farmer do to make sure he has a hay crop each year?\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/allenai/ai2_arc","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}