{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4ac00a97-0cf3-5864-9210-8cb79c33136a","task_key":"default--test--6839","task_revision_id":"1","upstream_id":"6839","short_description":"The market for Cincinnati Reds baseball tickets is currently in equilibrium.…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['The Reds decrease ticket prices due to lower stadium maintenance costs.', 'The Reds launch a new marketing campaign that increases ticket demand.', 'The Reds decide to limit the number of games in a season.', 'The Reds offer discounted parking for all home games.', 'The Reds increase ticket prices due to a rise in player salaries.', 'The Reds announce an increase in the price of merchandise at the stadium.', 'The city of Cincinnati imposes an entertainment tax on all sports events.', 'The Reds increase hot dog prices to reflect a higher cost of buns.', 'The city of Cincinnati is undertaking a huge highway construction project that strands fans in pregame traffic jams for hours.', 'The Reds must increase ticket prices to afford the most talented players.']\",\"question\":\"The market for Cincinnati Reds baseball tickets is currently in equilibrium. Which of the following events would most likely increase the consumer surplus received by Reds fans?\",\"src\":\"ori_mmlu-high_school_microeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}