{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3f629ea9-ae74-5da2-abcd-213637f1fb37","task_key":"default--test--282","task_revision_id":"1","upstream_id":"282","short_description":"Ms. Edwards' disposable income (that is, her income after taxes have been paid)…","config":"default","split":"test","body":"{\"category\":\"business\",\"options\":\"['Marginal propensity to consume is .70, marginal propensity to save is .30', 'Marginal propensity to consume is .80, marginal propensity to save is .20', 'Marginal propensity to consume is .95, marginal propensity to save is .05', 'Marginal propensity to consume is .85, marginal propensity to save is .15', 'Marginal propensity to consume is .75, marginal propensity to save is .25', 'Marginal propensity to consume is .50, marginal propensity to save is .50', 'Marginal propensity to consume is .55, marginal propensity to save is .45', 'Marginal propensity to consume is .60, marginal propensity to save is .40', 'Marginal propensity to consume is .65, marginal propensity to save is .35', 'Marginal propensity to consume is 1.00, marginal propensity to save is 0.00']\",\"question\":\"Ms. Edwards' disposable income (that is, her income after taxes have been paid) has risen from $19,000 to $20,000. Her expenditures have risen from $15,200 to $15,950. 1) What is her marginal propensity to consume? 2) What is her marginal propensity to save?\",\"src\":\"stemez-Business\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}