{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c5d168da-d081-5e0c-b8eb-eedb5a2180c7","task_key":"all--test--c5d168da-d081-5e0c-b8eb-eedb5a2180c7","task_revision_id":"1","upstream_id":"","short_description":"Suppose that the value of $R^2$ for an estimated regression model is exactly…","config":"all","split":"test","body":"{\"choices\":\"['(ii) and (iv) only', '(i) and (iii) only', '(i), (ii), and (iii) only', '(i), (ii), (iii), and (iv)']\",\"question\":\"Suppose that the value of $R^2$ for an estimated regression model is exactly zero. Which of the following are true?\\n\\ni) All coefficient estimates on the slopes will be zero\\n\\nii) The fitted line will be horizontal with respect to all of the explanatory variables\\n\\niii) The regression line has not explained any of the variability of y about its mean value\\n\\niv) The intercept coefficient estimate must be zero.\",\"subject\":\"econometrics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}