{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fa597771-36f4-5b58-ac83-324f96054ffd","task_key":"default--test--8122","task_revision_id":"1","upstream_id":"8122","short_description":"The distribution of salaries of a county school system with 4,752 employees is…","config":"default","split":"test","body":"{\"category\":\"math\",\"options\":\"['the sample size is too large compared to the number of employees in the system to give a fair representation', 'the sample size is too small compared to the number of employees in the system to give a fair representation', 'a 95 percent t-confidence interval is not appropriate for this kind of data', 'the teacher salaries are not negotiable, but the superintendent’s salary is negotiable, so the superintendent’s salary should be excluded from the population sampled', 'the population standard deviation of the salaries of employees of this county school system is known', 'the salary distribution is not right skewed, but left skewed', 'the skewed salary distribution tells us that assumption of normality of the sampled population will not be satisfied', 'the population standard deviation of the salaries of employees of this county school system is not known', \\\"the superintendent's salary is not an outlier on the higher side\\\", 'the teacher salaries are negotiable, and the superintendent’s salary is not negotiable, so the superintendent’s salary should be included in the population sampled']\",\"question\":\"The distribution of salaries of a county school system with 4,752 employees is known to be right skewed, with the superintendent’s salary an outlier on the higher side. A random sample of 20 employees was taken and their salaries recorded. A 95 percent t-confidence interval for the mean salary of the county school system employees is ($15,360, $32,470). The t-confidence interval is not appropriate in this situation because\",\"src\":\"ori_mmlu-high_school_statistics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}