{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a43578f6-cae3-59b3-bf50-7bc4e408a81a","task_key":"default--test--8116","task_revision_id":"1","upstream_id":"8116","short_description":"A school board of a large school district is proposing a new dress code for…","config":"default","split":"test","body":"{\"category\":\"math\",\"options\":\"['There is no alternative hypothesis proposed for this test.', 'The number of successes and the number of failures for the two groups are not all large enough.', 'The shapes of the population distributions are not known.', 'The z-test is not designed for proportions.', 'The sample sizes are too small.', 'The sample sizes are different.', \\\"The sample wasn't randomly selected.\\\", \\\"The students who oppose the dress code don't represent the entire population.\\\", 'The sample sizes are too large.', 'The proportions of male and female are not equal.']\",\"question\":\"A school board of a large school district is proposing a new dress code for students. Some students feel that this dress code unfairly targets female students. To see if there is a difference between boys and girls in their opposition to the new dress code, they conduct a poll of 60 randomly selected male and 70 randomly selected female high school students in the district. They find that 66 females oppose the dress code and 50 males oppose the dress code. Which of the following explains why a two-proportion z-test is not appropriate?\",\"src\":\"ori_mmlu-high_school_statistics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}