{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"340a8480-6bc0-5acb-8ae6-cd330d1137c1","task_key":"default--test--7549","task_revision_id":"1","upstream_id":"7549","short_description":"What economic factors influence the choice of thebest com-bination of inputs by…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Brand reputation and advertising', 'Demand and supply', 'Technological innovation and research and development', 'Production function and prices of inputs', \\\"Company's ethical policies and social responsibility initiatives\\\", 'Market competition', 'Interest rates and exchange rates', 'Consumer preferences and cultural trends', 'Government regulations', 'Weather patterns and climate change']\",\"question\":\"What economic factors influence the choice of thebest com-bination of inputs by a firm?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}