{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3a1bb436-936d-5242-a434-f470db5799aa","task_key":"default--test--8884","task_revision_id":"1","upstream_id":"8884","short_description":"Which of the following is NOT true of the χ2 probability distribution function?","config":"default","split":"test","body":"{\"category\":\"math\",\"options\":\"['For small degrees of freedom, the curve displays strong right-skewness.', 'The area under the χ2 curve is 1.', 'χ2 is defined only for nonnegative values of the variable.', 'For the same α, as the number of degrees of freedom decreases, the critical value for the rejection region increases.', 'For the same α, as the number of degrees of freedom increases, the critical value for the rejection region decreases.']\",\"question\":\"Which of the following is NOT true of the χ2 probability distribution function?\",\"src\":\"ori_mmlu-high_school_statistics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}