{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2a570430-0a59-5340-b665-0d70064da3e6","task_key":"default--test--261","task_revision_id":"3","upstream_id":"261","short_description":"_______, where actors are convinced that their actions harms nobody, _______…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['Appeal to higher loyalties, Metaphor of the ledger, Denial of injury', 'Denial of injury, Metaphor of the ledger, Appeal to higher loyalties,', 'Denial of injury, Metaphor of the balance, Appeal to higher loyalties', 'Metaphor of the ledger, Denial of injury, Appeal to higher loyalties', 'Denial of responsibility, Metaphor of the ledger, Appeal to higher loyalties', 'Appeal to higher loyalties, Denial of injury, Metaphor of the ledger', 'Denial of victim, Appeal to higher loyalties, Metaphor of the ledger', 'Appeal to higher loyalties, Denial of responsibility, Metaphor of the ledger', 'Metaphor of the ledger, Denial of victim, Appeal to higher loyalties', 'Denial of injury, Appeal to higher loyalties, Metaphor of the ledger']\",\"question\":\" _______, where actors are convinced that their actions harms nobody, _______ where actors argue that their norm violation is an attempt to realize higher-order values and ________ , where actors argue they are owed something, are all strategies for justifying or denying unethical behaviour.\",\"src\":\"ori_mmlu-business_ethics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}