{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"23818abd-0438-592b-8486-baae171b5b61","task_key":"default--test--7387","task_revision_id":"1","upstream_id":"7387","short_description":"How can business expectations affect the economy?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Business expectations can affect the economy by affecting the level of investment.', 'Business expectations mold the economy through fluctuations in commodity prices.', 'Business expectations have no impact on the economy.', 'Business expectations steer the economy by directly setting interest rates.', 'Business expectations influence the economy through government policy changes.', 'Business expectations determine the economy by dictating tax legislation.', 'Business expectations affect the economy by influencing customer behavior.', 'Business expectations guide the economy by influencing consumer savings rates.', 'Business expectations shift the economy by controlling foreign exchange rates.', 'Business expectations impact the economy by altering the unemployment rate directly.']\",\"question\":\"How can business expectations affect the economy?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}