{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f809c13f-af44-58d8-a1cc-e4b836fd861b","task_key":"all--test--f809c13f-af44-58d8-a1cc-e4b836fd861b","task_revision_id":"1","upstream_id":"","short_description":"Which of the following questions can a student ask to best determine whether an…","config":"all","split":"test","body":"{\"choices\":\"['Does the author use tone and style to convey authority on the subject to the audience?', 'Does the author use credible and reliable sources to convince the audience of the argument?', 'Does the author use facts and sound reasoning to substantiate claims made to the audience?', \\\"Does the author use personal connections and stories to appeal to the audience's emotions?\\\"]\",\"question\":\"Which of the following questions can a student ask to best determine whether an author is using the persuasive technique of pathos in a passage?\",\"subject\":\"miscellaneous\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}