{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dbe2dd92-f5a7-517a-a019-0f3bdc2a9ca6","task_key":"default--test--824","task_revision_id":"1","upstream_id":"824","short_description":"According to Evan and Freeman (1993), the Principle of ________ and the…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['Corporate liability, Corporate effect, Stakeholder', 'Corporate rights, Corporate effect, Stakeholder', 'Corporate rights, Corporate effect, Shareholder', 'Corporate responsibility, Corporate effect, Shareholder', 'Corporate rights, Corporate liability, Shareholder', 'Corporate deniability, Corporate responsibility, Shareholder', 'Corporate rights, Corporate responsibility, Stakeholder', 'Corporate liability, Corporate responsibility, Stakeholder', 'Corporate responsibility, Corporate liability, Stakeholder', 'Corporate deniability, Corporate effect, Stakeholder']\",\"question\":\"According to Evan and Freeman (1993), the Principle of ________ and the Principle of _______ can be used in a specific situation to determine who constitutes a _______.\",\"src\":\"ori_mmlu-business_ethics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}