{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d3fcb50a-6ff5-5d67-b3d3-a43eded141e6","task_key":"default--test--2627","task_revision_id":"1","upstream_id":"2627","short_description":"There are several differences between Parametric and Nonparametric Statistical…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['They are more robust and flexible', 'They are based on homogeneity of variance', 'They are used for ordinal and nominal data', 'They are less sensitive to outliers', 'They do not assume an underlying population distribution', 'They are based on Independence of Observations', 'They are based on normal distribution', 'They can be used when data is not normally distributed', 'They are used when the sample size is small']\",\"question\":\"There are several differences between Parametric and Nonparametric Statistical Tests, for ex. Nonparametric Statistical Tests are less powerful than parametric tests. From your knowledge about the parametric tests, which statement can not be correct?\",\"src\":\"ori_mmlu-professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}