{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"218c0509-8e33-5538-9011-46f4b7362464","task_key":"all--test--218c0509-8e33-5538-9011-46f4b7362464","task_revision_id":"1","upstream_id":"","short_description":"Which of the following statements are true concerning a triangular or recursive…","config":"all","split":"test","body":"{\"choices\":\"['(ii) and (iv) only', '(i) and (iii) only', '(i), (ii), and (iii) only', '(i), (ii), (iii), and (iv)']\",\"question\":\"Which of the following statements are true concerning a triangular or recursive system?\\n\\ni) The parameters can be validly estimated using separate applications of OLS to\\n\\neach equation\\n\\n\\nii) The independent variables may be correlated with the error terms in other\\n\\nequations\\n\\n\\niii) An application of 2SLS would lead to unbiased but inefficient parameter estimates\\n\\n\\niv) The independent variables may be correlated with the error terms in the equations\\n\\nin which they appear as independent variables\",\"subject\":\"econometrics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}