{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d25428f9-4d18-54ec-ba41-385bbc7a4425","task_key":"default--test--7341","task_revision_id":"1","upstream_id":"7341","short_description":"What were the factors that contributed to the failureof agricultureto share in…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Decreased technological advances leading to lower production efficiency', 'An increase in the cost of agricultural inputs without a corresponding rise in product prices', 'High domestic demand for farm products', 'A surplus in foreign markets leading to decreased exports', 'High import tariffs on foreign agricultural goods', 'Technological advances, import tariffs, low domestic demand for farm products, increased supply', 'A major shift to service-based industries reducing the workforce in agriculture', 'Decrease in import tariffs', 'Government subsidies for agricultural products', 'Increased foreign demand for US goods']\",\"question\":\"What were the factors that contributed to the failureof agricultureto share in the prosperity that other segments of theeconomy did immediately after the post-war depres-sion in1920?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}