{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"62e64031-cf52-5efd-a693-f6a48fd90528","task_key":"default--test--7146","task_revision_id":"1","upstream_id":"7146","short_description":"How did Joseph Schumpeter build his theory of the business cycle, and of growth,…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['The business cycle and growth are driven primarily by traditional industries, with little impact from technological progress.', 'Without technological progress, there would be no business cycle or growth.', 'Business cycles and growth are mainly the result of random market fluctuations, with technological progress playing a minor role.', 'Technological progress and imaginative, risk-taking innovators were the keys to the business cycle, and to growth.', 'Technological progress is the only factor in the business cycle and growth, with no contribution from entrepreneurs.', 'Technological progress and growth are unrelated to the business cycle.', 'Technological progress is solely determined by government policies, which in turn drive the business cycle and growth.', 'Technological progress hinders the business cycle and growth.', 'Schumpeter believed that business cycles and growth are perpetuated by consumer demand, not technological progress.', 'Technological progress disrupts the business cycle and growth by causing economic downturns.']\",\"question\":\"How did Joseph Schumpeter build his theory of the business cycle, and of growth, from the idea of embodied techno- logical progress?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}