{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8eca34cd-e41f-54ca-92df-da7a16ce522b","task_key":"default--test--365","task_revision_id":"1","upstream_id":"365","short_description":"What is not an assumption underpinning the rational decision making model?","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['Decisions are made in a vacuum, without influence from outside factors', 'Decisions are always optimal and maximize utility', \\\"The decision maker's preferences are stable and consistent\\\", 'High level of certainty regarding the environment', 'Unlimited time for making a decision', 'A structured problem', 'Perfect knowledge of all possible options and their outcomes', 'Incomplete information', 'An agreed goal', 'Rationality of the decision maker']\",\"question\":\"What is not an assumption underpinning the rational decision making model?\",\"src\":\"ori_mmlu-management\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}