{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ad16d28a-86ee-54df-8822-d4336d08594f","task_key":"all--test--ad16d28a-86ee-54df-8822-d4336d08594f","task_revision_id":"1","upstream_id":"","short_description":"For the regression line, which of the following statements about residuals is…","config":"all","split":"test","body":"{\"choices\":\"['Influential scores have large residuals.', 'If the linear model is good, the number of positive residuals will be the same as the number of negative residuals.', 'The mean of the residuals is always zero.', 'If the correlation is 0, there will be a distinct pattern in the residual plot.']\",\"question\":\"For the regression line, which of the following statements about residuals is true?\",\"subject\":\"high_school_statistics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}