{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8bfa649c-0bd8-5794-81fd-4e665aec7803","task_key":"default--test--7390","task_revision_id":"1","upstream_id":"7390","short_description":"Give the significance of the Agricultural Adjustment Act of 1933.","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['The Agricultural Adjustment Act of 1933 was primarily focused on enhancing military food supplies.', 'The Agricultural Adjustment Act of 1933 prohibited the use of modern farming equipment to preserve traditional methods.', 'The Agricultural Adjustment Act of 1933 introduced a fixed-rate tax on all agricultural exports.', 'The Agricultural Adjustment Act of 1933 established the concept of parity as a cornerstone of agricultural policy.', 'The Agricultural Adjustment Act of 1933 mandated the industrialization of all farming activities.', 'The Agricultural Adjustment Act of 1933 related to urban development policy.', 'The Agricultural Adjustment Act of 1933 deregulated crop prices and removed government involvement in agriculture.', 'The Agricultural Adjustment Act of 1933 abolished the concept of parity.', 'The Agricultural Adjustment Act of 1933 aimed to increase agricultural production to reduce food prices.', 'The Agricultural Adjustment Act of 1933 reduced the importance of agricultural policy.']\",\"question\":\"Give the significance of the Agricultural Adjustment Act of 1933.\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}