{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5c1db917-57a9-5813-b5e1-8b521a51c5b5","task_key":"default--test--7458","task_revision_id":"1","upstream_id":"7458","short_description":"Using the data provided in the accompanying table, compute the marginal and…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['7 thousand people', '9 thousand people', '6 thousand people', '8 thousand people']\",\"question\":\"Using the data provided in the accompanying table, compute the marginal and average physical productivities. What is the \\\"optimum\\\" population (level of population with highest per capita income) for this economy? Population (Thousands) Total Physical Product (Thousand Tons) Marginal Physical Product (Thousand Tons) Average Physical (Tons) 1 10 - - 2 22 - - 3 36 - - 4 52 - - 5 70 - - 6 90 - - 7 108 - - 8 124 - - 9 135 - -\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}