{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"787ea580-0612-5adb-a5ae-492001bf027a","task_key":"default--test--6987","task_revision_id":"1","upstream_id":"6987","short_description":"Which of the following is true about the relationship of the average total cost…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['ATC and MC are always equal.', 'ATC and MC are never equal.', 'The ATC curve and MC curve are parallel to each other.', 'The MC curve intersects the ATC curve at the maximum point of the ATC curve.', 'The MC curve intersects the ATC curve at the midpoint of the ATC curve.', 'The ATC curve is always above the MC curve.', 'The ATC curve intersects the MC curve at the maximum point of the MC curve.', 'The MC curve intersects the ATC curve at the minimum point of the ATC curve.', 'The MC curve is always above the ATC curve.', 'The ATC curve intersects the MC curve at the minimum point of the MC curve.']\",\"question\":\"Which of the following is true about the relationship of the average total cost (ATC) curve and the marginal cost (MC) curve?\",\"src\":\"ori_mmlu-high_school_microeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}