{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c910e3a8-8dd6-54d3-8e2c-905e497a1779","task_key":"all--test--c910e3a8-8dd6-54d3-8e2c-905e497a1779","task_revision_id":"1","upstream_id":"","short_description":"What is the problem of 'fragmentation' of international law?","config":"all","split":"test","body":"{\"choices\":\"['Fragmentation of international law concerns the possibility of different legal regimes apply the same rules of international law', 'It is possible for several legal regimes (ie foreign investment law and human rights law) to exist and develop in isolation of each other, ultimately culminating in the production of divergent rules of international law', 'Fragmentation is when States assume different interpretations of the same rule of international law', 'Fragmentation is when States disagree to abide by a certain rule of international law']\",\"question\":\"What is the problem of 'fragmentation' of international law?\",\"subject\":\"international_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}