{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"23c8a570-06ec-5d98-87cd-f5d59f099389","task_key":"default--test--5290","task_revision_id":"1","upstream_id":"5290","short_description":"In what ways may TNC be regarded as a new concept?","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['Organized transnational crime groups are those structured groups randomly formed or otherwise but do not have a formally defined role for its members or continuity of membership but have a developed purpose for the intent of committing crimes.', 'Transnational organized criminal activities consist of profit driven crime for a high level return that may result in the subversion or infiltration of the legal economy through the reinvestment of illicit profits.', 'Transnational criminal organizations are those organizations whose modes of operation result in breaking domestic laws, e.g. murder, theft or money-laundering, underlined by the employment of systematic violence.', \\\"The terms 'transnational crime' and 'organized crime' are sometimes used interchangeably but not all transnational crime will be committed by an organized group nor will all organized groups engage in transnational crime. The pursuit of profit for illicit activity eludes definition and may include those individuals or businesses that engage in occasional transnational criminal activity but are otherwise legitimate operatives.\\\"]\",\"question\":\"In what ways may TNC be regarded as a new concept?\",\"src\":\"ori_mmlu-security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}