{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f55a6fa1-86ee-509a-b742-043c963d8d11","task_key":"default--test--7278","task_revision_id":"1","upstream_id":"7278","short_description":"Explain the \"other things equal\", or ceteris paribus assumption of economic…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['It is the presumption that economic outcomes can be predicted with certainty', 'It implies that economic variables move in a linear and predictable fashion', 'It is the assumption that economic variables do not affect one another', 'It is the belief that supply and demand are the only forces shaping the economic market', 'It assumes that the economic behavior of individuals is not influenced by external factors', 'It is the assumption that price is the only factor affecting economic decisions', 'It is the assumption that the economy can only be analyzed in a static environment', 'It is the assumption that all factors are equally important', 'It is the assumption that all economic variables change at the same rate', \\\"The 'other things equal' assumption in economic analysis is the assumption that all other factors influencing a variable can be held constant while analyzing the effect of changes in one factor.\\\"]\",\"question\":\"Explain the \\\"other things equal\\\", or ceteris paribus assumption of economic analysis.\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}