{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2cc61dc4-da30-5ed8-844f-ce53ac7f0824","task_key":"default--test--5074","task_revision_id":"1","upstream_id":"5074","short_description":"Which of the following statements is not applicable to the Securitization…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['Where the securitizing actor is a democratic state, the relevant audience is usually the wider population who have the right to reject the speech act.', 'Securitization reveals the power of the securitizing actor.', 'The adoption of extraordinary measures can retrospectively convince an audience of the existential threat.', 'The process of securitization is always reversible.', 'Within authoritarian and other undemocratic regimes, the relevant political decision-making is often dominated by the military and political elite.']\",\"question\":\"Which of the following statements is not applicable to the Securitization process?\",\"src\":\"ori_mmlu-security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}