{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"86f30cdb-a952-54eb-81e8-18b821fe37dc","task_key":"default--test--289","task_revision_id":"1","upstream_id":"289","short_description":"The total cost of producing x cameras is C(x) = 2 + x^3. What is the average…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['Average Cost: $1000/unit, Marginal Cost: $100', 'Average Cost: $300/unit, Marginal Cost: $100', 'Average Cost: $300/unit, Marginal Cost: $1000', 'Average Cost: $102/unit, Marginal Cost: $301', 'Average Cost: $500/unit, Marginal Cost: $1000', 'Average Cost: $100/unit, Marginal Cost: $100', 'Average Cost: $200/unit, Marginal Cost: $300', 'Average Cost: $2/unit, Marginal Cost: $30', 'Average Cost: $1020/unit, Marginal Cost: $299', 'Average Cost: $100/unit, Marginal Cost: $300']\",\"question\":\"The total cost of producing x cameras is C(x) = 2 + x^3. What is the average cost if 10 cameras are made? What is the marginal cost of producing 10 cameras?\",\"src\":\"stemez-Business\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}