{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0006bd5f-40f8-5c3b-a171-d5ea78e80aa6","task_key":"default--test--8546","task_revision_id":"1","upstream_id":"8546","short_description":"A small kiosk at the Atlanta airport carries souvenirs in the price range of…","config":"default","split":"test","body":"{\"category\":\"math\",\"options\":\"['The range and standard deviation of prices will increase by 50 cents, but the mean price will remain the same.', 'The standard deviation of prices will increase by 50 cents, but the mean price and the range will remain the same.', 'The mean price will increase by 50 cents, but the standard deviation of prices will remain the same.', 'The mean price will remain the same, but the standard deviation of prices will increase by 50 cents.', 'The mean price and the range of prices will increase by 50 cents.', 'The mean price and the standard deviation of prices will increase by 50 cents.', 'The mean price will remain the same, but the range of prices will increase by 50 cents.', 'The mean price will increase by 50 cents, but the range of prices will decrease by 50 cents.', 'The mean price, the range, and the standard deviation of prices will all remain the same.', 'The range of prices will increase by 50 cents, but the mean price and the standard deviation will remain the same.']\",\"question\":\"A small kiosk at the Atlanta airport carries souvenirs in the price range of $3.99 to $29.99, with a mean price of $14.75. The airport authorities decide to increase the rent charged for a kiosk by 5 percent. To make up for the increased rent, the kiosk owner decides to increase the prices of all items by 50 cents. As a result, which of the following will happen?\",\"src\":\"ori_mmlu-high_school_statistics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}