{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0914b701-8cb9-5371-b029-eca3dbb530f9","task_key":"default--test--6851","task_revision_id":"1","upstream_id":"6851","short_description":"\"Allowing the prices of goods to rise in periods when none of the good is being…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Disagree due to higher price permitting a re-allocation of existing goods', 'Agree due to unjust enrichment', 'Agree due to unwarranted profits', 'Disagree due to government interference']\",\"question\":\"\\\"Allowing the prices of goods to rise in periods when none of the good is being produced is immoral, because the higher prices do not induce a larger output. They merely give unwarranted profits to those who are lucky enough to own the goods. Either prices should be prevented from rising or the government should take over ownership in order to prevent unjust enrichment quotas.\\\"Do you agree withthis analysis ?If so, why?If not, why not?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}