{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e4158533-ec91-5419-a624-99530e3e32f7","task_key":"default--test--1383","task_revision_id":"1","upstream_id":"1383","short_description":"Is extra-territorial abduction a ground for refusal of otherwise lawful…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['Such abduction is encouraged to expedite the course of justice', 'Extra-territorial abduction has no influence on the proceedings of English courts', 'The stay of proceedings under such circumstances would prevent the administration of justice in respect of international criminals', 'Such abduction results in immediate dismissal of the case', 'The jurisdiction of English courts is nullified in cases of extra-territorial abduction', \\\"Such abduction gives rise to the abductor's liability but does not lead to a stay of proceedings\\\", 'English courts will always refuse jurisdiction in cases of extra-territorial abduction', 'Such abduction constitutes abuse of process and leads to a stay of proceedings', 'The court proceedings are automatically stayed if the abductee is a non-UK citizen']\",\"question\":\"Is extra-territorial abduction a ground for refusal of otherwise lawful jurisdiction by English courts?\",\"src\":\"ori_mmlu-international_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}