{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fa9273cc-3ab0-5a49-96e1-c26fd497ba3c","task_key":"all--test--fa9273cc-3ab0-5a49-96e1-c26fd497ba3c","task_revision_id":"1","upstream_id":"","short_description":"_______, where actors are convinced that their actions harms nobody, _______…","config":"all","split":"test","body":"{\"choices\":\"['Appeal to higher loyalties, Denial of injury, Metaphor of the ledger', 'Appeal to higher loyalties, Metaphor of the ledger, Denial of injury', 'Denial of injury, Appeal to higher loyalties, Metaphor of the ledger', 'Denial of injury, Metaphor of the ledger, Appeal to higher loyalties,']\",\"question\":\" _______, where actors are convinced that their actions harms nobody, _______ where actors argue that their norm violation is an attempt to realize higher-order values and ________ , where actors argue they are owed something, are all strategies for justifying or denying unethical behaviour.\",\"subject\":\"business_ethics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}