{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5f6bc700-ce94-5054-852d-0fed0127471a","task_key":"all--test--5f6bc700-ce94-5054-852d-0fed0127471a","task_revision_id":"1","upstream_id":"","short_description":"Crop rotation is the successive planting of different crops on the same land in…","config":"all","split":"test","body":"{\"choices\":\"['It allows the farmer to plant the crops with the greatest demand in the marketplace.', 'It increases crop yields and soil fertility and minimizes pathogen infection and pest infestation.', 'It allows the hybridization of successive crops and the development of newer varieties of crop plants.', 'It decreases the need for diverse harvesting equipment and minimizes production costs.']\",\"question\":\"Crop rotation is the successive planting of different crops on the same land in sequential seasons. Which of the following statements summarizes the most likely benefits of this practice?\",\"subject\":\"high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}