{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8f66a447-8734-5187-a763-2f87ad987ea7","task_key":"default--test--7616","task_revision_id":"1","upstream_id":"7616","short_description":"Given the cost schedule for the Northwestern Lumber Company, find a) the range…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Profitable range is 4,000 to 8,000 board feet per day, maximum profit at 7,000 board feet per day', 'Profitable range is 7,000 to 11,000 board feet per day, maximum profit at 10,000 board feet per day', 'Profitable range is 7,500 to 11,500 board feet per day, maximum profit at 10,500 board feet per day', 'Profitable range is 5,000 to 10,000 board feet per day, maximum profit at 6,000 board feet per day', 'Profitable range is 6,500 to 10,500 board feet per day, maximum profit at 9,500 board feet per day', 'Profitable range is 8,000 to 12,000 board feet per day, maximum profit at 11,000 board feet per day', 'Profitable range is 5,000 to 9,000 board feet per day, maximum profit at 8,000 board feet per day', 'Profitable range is 6,000 to 10,000 board feet per day, maximum profit at 9,000 board feet per day', 'Profitable range is 6,000 to 11,000 board feet per day, maximum profit at 8,000 board feet per day', 'Profitable range is 5,500 to 9,500 board feet per day, maximum profit at 8,500 board feet per day']\",\"question\":\"Given the cost schedule for the Northwestern Lumber Company, find a) the range over which profit can be made b) the point at which profit is maximized, if price = $52.50 per thousand board feet.\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}