{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9a3d76f5-d548-5986-9c58-85ec46651b30","task_key":"all--test--9a3d76f5-d548-5986-9c58-85ec46651b30","task_revision_id":"1","upstream_id":"","short_description":"Consider the OLS estimator for the standard error of the slope coefficient.…","config":"all","split":"test","body":"{\"choices\":\"['(ii) and (iv) only', '(i) and (iii) only', '(i), (ii), and (iii) only', '(i), (ii), (iii), and (iv)']\",\"question\":\"Consider the OLS estimator for the standard error of the slope coefficient. Which of the following statement(s) is (are) true?\\n\\n(i) The standard error will be positively related to the residual variance\\n\\n(ii) The standard error will be negatively related to the dispersion of the observations on the explanatory variable about their mean value\\n\\n(iii) The standard error will be negatively related to the sample size\\n\\n(iv) The standard error gives a measure of the precision of the coefficient estimate.\",\"subject\":\"econometrics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}