{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"12bd375f-6ddd-5d4b-9eeb-3536261b23b8","task_key":"default--test--7170","task_revision_id":"1","upstream_id":"7170","short_description":"If the per unit price of labor, a variable resource, increases, it causes which…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['A downward shift in MPL.', 'A downward shift in AFC.', 'A downward shift in ATC.', 'An upward shift in AVC.', 'A downward shift in MC.', 'An upward shift in TFC.', 'An upward shift in MPL.', 'An upward shift in MC.', 'An upward shift in AFC.', 'An upward shift in ATC.']\",\"question\":\"If the per unit price of labor, a variable resource, increases, it causes which of the following?\",\"src\":\"ori_mmlu-high_school_microeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}