{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8137c93d-6920-5459-b6e7-d2551ce5a0e9","task_key":"all--test--8137c93d-6920-5459-b6e7-d2551ce5a0e9","task_revision_id":"1","upstream_id":"","short_description":"A student at a private university was receiving financial aid from the…","config":"all","split":"test","body":"{\"choices\":\"['The university was in financial difficulties and could not meet its payroll expenses.', \\\"The university did not re-allocate the student's financial aid to another deserving student.\\\", 'The university received support from the state.', 'The honor committee sent the student a letter to advise him of the hearing date.']\",\"question\":\"A student at a private university was receiving financial aid from the university based on a financial aid application he completed at the time of his enrollment. During finals at the end of the fall semester, the student was caught cheating. His chemistry professor saw him looking at a fellow student's exam paper and copying the answers to three multiple choice questions. The professor notified the honor committee, which immediately found an honor code violation and ordered that the student receive a failing grade in the course. In addition, in accordance with the rules of the university, the student's financial aid was terminated. The student filed a lawsuit seeking reinstatement of his financial aid. The student's only argument was that his due process rights were violated in that he did not receive a notice of, or a hearing on, the alleged honor code violation. Which of the following facts, if true, would be most helpful to the student?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}