{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e886de4f-e9f7-5464-b581-9f3e3eb0ea75","task_key":"default--test--1982","task_revision_id":"1","upstream_id":"1982","short_description":"Congress has recently enacted a statute requiring all males between the ages of…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['The full faith and credit clause.', 'The dormant commerce clause.', 'The necessary and proper clause.', 'The equal protection clause.', 'The commerce clause.', 'The supremacy clause.', 'To raise and support an army and navy.', 'The privileges and immunities clause.', 'To provide for the general welfare.', 'The due process clause.']\",\"question\":\"Congress has recently enacted a statute requiring all males between the ages of 18 and 30 to take a physical examination each year. The results of the exam are sent to a government data information center for the purpose of keeping information about men who may be drafted into the military. A 25-year-old law school graduate has herpes. He has recently sent resumes to many governmental agencies. Fearful that the information about his herpes condition will become available, he seeks a declaratory judgment that would forbid the government from requiring him to take a physical examination. Which of the following is the best constitutional basis in support of the federal law?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}