{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0ef9050b-c9e3-52b3-af57-53d6d064820c","task_key":"default--test--7199","task_revision_id":"1","upstream_id":"7199","short_description":"Restate the utility-maximizing rule in algebraic terms.","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['MU_A / Price_B = MU_B / Price_A = MU_C / Price_D = MU_D / Price_C', 'MU_A = MU_B = MU_C = MU_D', 'MU_A + MU_B = Price_A + Price_B', 'MU_A - MU_B = Price_A - Price_B', 'MU_A * MU_B * MU_C * MU_D = Price_A * Price_B * Price_C * Price_D', 'MU_A ^2 / Price_A = MU_B ^2 / Price_B', 'MU_A * Price_A = MU_B * Price_B = MU_C * Price_C = MU_D * Price_D', 'MU_A / MU_B = Price_A / Price_B', 'MU_A / Price_A ^2 = MU_B / Price_B ^2 = MU_C / Price_C ^2 = MU_D / Price_D ^2', '(MU_A /Price_A) = (MU_B /Price_B) = (MU_C /Price_C) = (MU_D /Price_D)']\",\"question\":\"Restate the utility-maximizing rule in algebraic terms.\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}