{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e57204bc-31f4-5143-af45-e8e5f4b3837c","task_key":"default--test--7648","task_revision_id":"1","upstream_id":"7648","short_description":"With capital fixed at one unit with 1, 2, 3 units of labor added in equal…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['This is long run constant returns to scale.', 'This is short run decreasing returns to scale.', 'This is long run increasing returns to scale.', 'This is long run decreasing returns to scale.', 'This is short run increasing returns to scale.', 'This is long run diminishing marginal productivity.', 'This is the effect of labor saturation.', 'This is due to labor specialization efficiency.', 'This is short run diminishing marginal productivity.', 'This is short run constant returns to scale.']\",\"question\":\"With capital fixed at one unit with 1, 2, 3 units of labor added in equal successive units, production of the output increases from 300 (1 unit of labor), to 350 (2 units of labor) to 375 (3 units of labor). Which of the following is a correct interpretation?\",\"src\":\"ori_mmlu-high_school_microeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}