{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7f8bac64-2239-50a1-a833-20a72fde5425","task_key":"default--test--8112","task_revision_id":"1","upstream_id":"8112","short_description":"A company is interested in comparing the mean sales revenue per salesperson at…","config":"default","split":"test","body":"{\"category\":\"math\",\"options\":\"['The population of the sales records at each location is not normally distributed.', 'The population of the sales records at each location is normally distributed.', 'The sample size at both locations is less than 30', 'The population standard deviations at both locations are equal.', 'The sales revenue is measured on an interval or ratio scale.', 'The population of the sales records at each location follows a uniform distribution.', 'The population standard deviations at both locations are not equal.', 'The population standard deviations at both locations are known.', 'The population mean sales revenue at both locations are not equal.', 'The population mean sales revenue at both locations are equal.']\",\"question\":\"A company is interested in comparing the mean sales revenue per salesperson at two different locations. The manager takes a random sample of 10 salespeople from each location independently and records the sales revenue generated by each person during the last four weeks. He decides to use a t-test to compare the mean sales revenue at the two locations. Which of the following assumptions is necessary for the validity of the t-test?\",\"src\":\"ori_mmlu-high_school_statistics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}