{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"36b5a668-bcb5-537b-a177-34a2fb82b377","task_key":"all--test--36b5a668-bcb5-537b-a177-34a2fb82b377","task_revision_id":"1","upstream_id":"","short_description":"Every country with a seacoast has an exclusive economic zone (EEZ) under the UN…","config":"all","split":"test","body":"{\"choices\":\"['The EEZ extends up to 200 nautical miles (370 km) from the coastline.', 'Countries have the right to exploit natural resources in their EEZ.', 'Countries can exploit resources on the continental shelf extending up to 350 nautical miles (560 km) beyond their EEZ.', 'A country does not have the right to exploit living resources in its EEZ.']\",\"question\":\"Every country with a seacoast has an exclusive economic zone (EEZ) under the UN Convention on the Law of the Sea. Which one of the following statements regarding the Law of the Sea and the EEZ is NOT correct?\",\"subject\":\"high_school_geography\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}