{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"23c2d670-3b1d-5630-a0ce-6f152a11e56f","task_key":"default--test--1511","task_revision_id":"1","upstream_id":"1511","short_description":"A university student, a citizen of State A, believes that her university…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['Service by publication in a newspaper of general circulation in State B.', \\\"Service as required by State B's rules of civil procedure.\\\", 'Service by emailing copies of the summons and complaint to the athletic director and the university president.', 'Service by faxing copies of the summons and complaint to the athletic director and the university president.', 'Service by the student herself on the athletic director and the university president.', \\\"Service by a process server's leaving copies of the summons and complaint with copies of the summons and complaint with secretaries in the respective offices of the athletic director and the university president.\\\", \\\"Service by the student's attorney on the athletic director and the university president.\\\", \\\"Service by sending copies of the summons and complaint through the university's internal mail system.\\\", \\\"Service by leaving copies of the summons and complaint at the university's main entrance.\\\"]\",\"question\":\"A university student, a citizen of State A, believes that her university violated federal law when it eliminated funding for the women's varsity volleyball team. She has sued the university, a nonprofit corporation located and incorporated in State B, and the university's athletic director, a citizen of State B, in federal court in State B. What is the best method of serving the defendants?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}