{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2fa170ea-7275-5009-8de0-35dae857b2b9","task_key":"all--test--2fa170ea-7275-5009-8de0-35dae857b2b9","task_revision_id":"1","upstream_id":"","short_description":"Suppose that a hypothesis test is conducted using a 5% significance level. Which…","config":"all","split":"test","body":"{\"choices\":\"['(ii) and (iv) only', '(i) and (iii) only', '(i), (ii), and (iii) only', '(i), (ii), (iii), and (iv)']\",\"question\":\"Suppose that a hypothesis test is conducted using a 5% significance level. Which of the following statements are correct?\\n\\n(i) The significance level is equal to the size of the test\\n\\n(ii) The significance level is equal to the power of the test\\n\\n(iii) 2.5% of the total distribution will be in each tail rejection region for a 2-sided test\\n\\n(iv) 5% of the total distribution will be in each tail rejection region for a 2-sided test.\",\"subject\":\"econometrics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}