{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"de882448-59c0-5a55-81f5-5a89178425b4","task_key":"all--test--de882448-59c0-5a55-81f5-5a89178425b4","task_revision_id":"1","upstream_id":"","short_description":"The superintendent of a large school district asks the school psychologist to…","config":"all","split":"test","body":"{\"choices\":\"['The intercorrelation of the aptitude and achievement test scores', 'The degree to which the school interest inventory score raises the multiple correlation when it is included as a predictor variable of first-year high school GPA', 'The zero-order correlation of first-year high school GPA and the school interest inventory score', 'The difference in the correlations of the school interest inventory scores with first-year high school GPA and the aptitude and achievement test scores with first-year high school GPA']\",\"question\":\"The superintendent of a large school district asks the school psychologist to predict students' grade point averages (GPAs) for the first year of high school. The school psychologist has included achievement and aptitude scores as predictor variables for firstyear high school GPA in a regression analysis and is considering whether to also administer a school interest inventory and include those scores. The major concern of the school psychologist when making this decision should be which of the following?\",\"subject\":\"high_school_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}