{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2743891b-2ab2-595d-ab44-a0921c64809c","task_key":"all--test--2743891b-2ab2-595d-ab44-a0921c64809c","task_revision_id":"1","upstream_id":"","short_description":"Which of the following may be consequences of one or more of the CLRM…","config":"all","split":"test","body":"{\"choices\":\"['(ii) and (iv) only', '(i) and (iii) only', '(i), (ii), and (iii) only', '(i), (ii), (iii), and (iv)']\",\"question\":\"Which of the following may be consequences of one or more of the CLRM assumptions being violated?\\n\\ni) The coefficient estimates are not optimal\\n\\n\\nii) The standard error estimates are not optimal\\n\\n\\niii) The distributions assumed for the test statistics are inappropriate\\n\\n\\niv) Conclusions regarding the strength of relationships between the dependent\\n\\nand independent variables may be invalid.\",\"subject\":\"econometrics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}