{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c0f29b0b-87eb-56cd-99ae-ce39161ba301","task_key":"default--test--1295","task_revision_id":"1","upstream_id":"1295","short_description":"What is the effects doctrine?","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['It posits that jurisdiction exists only when it is ineffective', 'The effects doctrine serves to confer jurisdiction on the State sharing the nationality of the victim', 'The effects doctrine serves to confer jurisdiction on the State sharing the nationality of the offender', 'The effects doctrine posits that jurisdiction is solely determined by the severity of the harmful conduct', 'The effects doctrine serves to confer jurisdiction to the State on whose territory the conduct produces effects', 'The effects doctrine serves to confer jurisdiction to the State on whose territory the conduct originated', 'It posits that jurisdiction exists only when it is effective', 'The effects doctrine serves to confer jurisdiction to the State that is most affected by the harmful conduct', 'The effects doctrine serves to confer jurisdiction on the State which has an effective link with the harmful conduct', 'The effects doctrine serves to confer jurisdiction on the State where the offender resides']\",\"question\":\"What is the effects doctrine?\",\"src\":\"ori_mmlu-international_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}