{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"76f1bfea-879a-5e8f-88d5-b5143ebdcc99","task_key":"default--test--7086","task_revision_id":"1","upstream_id":"7086","short_description":"Explain Say's Law anddiscussits weakness.","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"[\\\"Say's Law states that government intervention is crucial for achieving full employment\\\", \\\"Say's Law suggests that savings are detrimental to the economy\\\", \\\"Say's Law implies that investment is not necessary for economic stability\\\", \\\"Say's Law argues that trade deficits are beneficial for long-term economic stability\\\", \\\"Say's Law maintains that consumption is less important than production for economic health\\\", \\\"Say's Law holds that the economy will always be close to full employment and assumes any income saved is automatically invested. It is only valid in situations where all savings are invested.\\\", \\\"Say's Law emphasizes the importance of government spending in regulating economic cycles\\\", \\\"Say's Law asserts that supply creates its own demand, but fails to consider that people may not spend all of their income\\\", \\\"Say's Law believes that higher taxes will lead to increased employment and economic activity\\\", \\\"Say's Law posits that inflation is the primary driver of economic growth\\\"]\",\"question\":\"Explain Say's Law anddiscussits weakness.\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}