{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c602d744-f4c9-5622-886d-c5ee7bf7c447","task_key":"default--test--700","task_revision_id":"1","upstream_id":"700","short_description":"The Extruded Plastics Company distributes overhead to each of its six…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['$5,000', '$2,285.71', '$4,000', '$4,285.71', '$3,428.57', '$1,142.86', '$3,500', '$1,000', '$1,714.29', '$2,857.14']\",\"question\":\"The Extruded Plastics Company distributes overhead to each of its six departments according to the ratio of total overhead to the total direct labor costs. During January, the total overhead for the factory was $20,000; the total direct labor cost $140,000. Find the ratio to be applied to all departments. Then find the amount to be charged to the Quality Control Department whose direct labor costs for the month were $16,000.\",\"src\":\"stemez-Business\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}