{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0d2dbeac-d5ba-5058-9a1b-898311b4562b","task_key":"default--test--5756","task_revision_id":"1","upstream_id":"5756","short_description":"Which of the following best describes an effect of the green revolution in the…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['Increased varieties of each crop planted', 'Reduced use of fertilizers', 'Increased use of natural farming methods', 'Decreased use of mechanization', 'Decreased use of pesticides', 'Decreased reliance on irrigation', 'Increased use of fertilizers', 'Reduced crop diversity', 'Decreased crop yields', 'Increased soil erosion']\",\"question\":\"Which of the following best describes an effect of the green revolution in the 1960s?\",\"src\":\"ori_mmlu-miscellaneous\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}