{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"07b6fb16-de14-5d8f-b3df-6e3e99436edf","task_key":"default--test--6902","task_revision_id":"1","upstream_id":"6902","short_description":"If corn is produced in a perfectly competitive market and the government placed…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Corn would become a luxury good due to the price ceiling.', 'The government would have to subsidize corn production.', 'The price of corn would increase dramatically.', 'The price of corn would remain the same but the quality would decrease.', 'The producers of corn would lose revenue due to the decreased price.', 'The demand for corn would decrease significantly.', 'There would be a surplus created of corn.', 'Corn producers would increase their output to meet the new demand.', 'There would be no change in the amount of corn demanded or supplied.', 'There would be a shortage created of corn.']\",\"question\":\"If corn is produced in a perfectly competitive market and the government placed a price ceiling above equilibrium, which of the following would be true?\",\"src\":\"ori_mmlu-high_school_microeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}