{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"00adf90f-cda1-594c-8426-1287206538d3","task_key":"default--test--1382","task_revision_id":"1","upstream_id":"1382","short_description":"Is extra-territorial abduction a ground for refusal of otherwise lawful…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['Such abduction constitutes abuse of process and leads to a stay of proceedings', \\\"Such abduction gives rise to the abductor's liability but does not lead to a stay of proceedings\\\", 'The stay of proceedings under such circumstances would prevent the administration of justice in respect of international criminals', 'The courts may, but will seldom, stay proceedings in cases of extra-territorial abduction']\",\"question\":\"Is extra-territorial abduction a ground for refusal of otherwise lawful jurisdiction by English courts?\",\"src\":\"ori_mmlu-international_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}