{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c1017ae7-5cda-53b0-9cd8-ad6f7ec2d66c","task_key":"all--test--c1017ae7-5cda-53b0-9cd8-ad6f7ec2d66c","task_revision_id":"1","upstream_id":"","short_description":"There are several differences between Parametric and Nonparametric Statistical…","config":"all","split":"test","body":"{\"choices\":\"['They are used for ordinal and nominal data', 'They are based on normal distribution', 'They are based on homogeneity of variance', 'They are based on Independence of Observations']\",\"question\":\"There are several differences between Parametric and Nonparametric Statistical Tests, for ex. Nonparametric Statistical Tests are less powerful than parametric tests. From your knowledge about the parametric tests, which statement can not be correct?\",\"subject\":\"professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}