{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e30d5d1c-8e81-5474-b0d4-b0955d83ffca","task_key":"default--test--6842","task_revision_id":"1","upstream_id":"6842","short_description":"What could the government do to most effectively avoid a free rider problem?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Supply public goods using tax dollars', 'Initiate a lottery system for the usage of public goods', 'Enact stricter antitrust legislation', 'Increase the prices of public goods', 'Allow private companies to supply public goods', 'Tax those creating negative externalities', 'Ban the use of public goods', 'Provide more complete information about the relevant goods', 'Reduce the production of public goods', 'Encourage voluntary contributions for public goods']\",\"question\":\"What could the government do to most effectively avoid a free rider problem?\",\"src\":\"ori_mmlu-high_school_microeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}