{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"07be4228-1cd3-575b-96b0-6ae00b45d868","task_key":"default--test--7376","task_revision_id":"1","upstream_id":"7376","short_description":"Suppose that a hypothesis test is conducted using a 5% significance level. Which…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['(ii), (iii), and (iv) only', '(i), (ii), and (iii) only', '(ii) and (iii) only', '(i), (iii), and (iv) only', '(iii) and (iv) only', '(ii) and (iv) only', '(i) and (iv) only', '(i) and (iii) only', '(i) and (ii) only', '(i), (ii), (iii), and (iv)']\",\"question\":\"Suppose that a hypothesis test is conducted using a 5% significance level. Which of the following statements are correct?\\n\\n(i) The significance level is equal to the size of the test\\n\\n(ii) The significance level is equal to the power of the test\\n\\n(iii) 2.5% of the total distribution will be in each tail rejection region for a 2-sided test\\n\\n(iv) 5% of the total distribution will be in each tail rejection region for a 2-sided test.\",\"src\":\"ori_mmlu-econometrics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}