{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"06dcd83a-0957-5731-815a-78e3cd42883c","task_key":"default--test--244","task_revision_id":"3","upstream_id":"244","short_description":"The McDougall Company produces and sells two qualities of carpet. The better…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['30000 yards and 90000 yards', '48500 yards and 72750 yards', '45000 yards and 75000 yards', '47833(1/3) yards and 71750 yards', '50000 yards and 60000 yards', '52000 yards and 78000 yards', '55000 yards and 65000 yards', '35000 yards and 70000 yards', '40000 yards and 80000 yards', '60000 yards of each type']\",\"question\":\"The McDougall Company produces and sells two qualities of carpet. The better quality carpeting sells for $6.00 per yard and has variable costs of 70 percent of sales. The other type costs $3.00 per yard and has variable costs of 60 percent of sales. Total fixed costs of both types of carpet combined are $122,200. If both carpets have the same dollar sales, how many yards of each must be sold to earn a profit of $50,000?\",\"src\":\"stemez-Business\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}