{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9304c439-73b1-51ea-836c-9f804ec500e3","task_key":"all--test--9304c439-73b1-51ea-836c-9f804ec500e3","task_revision_id":"1","upstream_id":"","short_description":"Which of the following statements is true concerning the population regression…","config":"all","split":"test","body":"{\"choices\":\"['The PRF is the estimated model', 'The PRF is used to infer likely values of the SRF', 'Whether the model is good can be determined by comparing the SRF and the PRF', 'The PRF is a description of the process thought to be generating the data.']\",\"question\":\"Which of the following statements is true concerning the population regression function (PRF) and sample regression function (SRF)?\",\"subject\":\"econometrics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}