{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"852934b0-c60c-5014-9090-3f7e9884ec25","task_key":"default--test--7291","task_revision_id":"1","upstream_id":"7291","short_description":"If households are more optimistic about the future how would the consumption…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['The marginal propensity to consume would decrease, decreasing the slope of the consumption function.', 'The marginal propensity to consume would increase increasing the slope of the consumption function.', 'The marginal propensity to save would increase, decreasing the slope of the consumption function.', 'The marginal propensity to consume would remain the same, keeping the consumption function stable.', 'The entire consumption function would shift to the right.', 'The entire consumption function would shift to the left.', 'The entire consumption function would shift upward.', 'The marginal propensity to consume would decrease increasing the slope of the consumption function.', 'The entire consumption function would shift downward.', 'The marginal propensity to save would decrease, increasing the slope of the consumption function.']\",\"question\":\"If households are more optimistic about the future how would the consumption function be affected?\",\"src\":\"ori_mmlu-high_school_macroeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}