{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"be6ac7ae-3b03-58cb-ba64-74cd12cd15fe","task_key":"default--test--3576","task_revision_id":"1","upstream_id":"3576","short_description":"When a swimmer leaves cold water on a warm, breezy day, he experiences a cooling…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"[\\\"The cold water causes a decrease in the swimmer's metabolic rate.\\\", 'The swimmer feels cold due to the temperature difference.', \\\"Evaporation of water from the swimmer's skin cools the body down.\\\", 'The swimmer feels cold due to the wind chill factor.', \\\"The swimmer's body is adapting to the water temperature after exiting.\\\", \\\"The water removes heat from the swimmer's body.\\\", \\\"The sun's rays are less effective on the swimmer's wet skin.\\\", \\\"The water on the swimmer's body freezes.\\\", 'The breeze makes the swimmer feel cold.', \\\"The swimmer's body temperature drops below normal.\\\"]\",\"question\":\"When a swimmer leaves cold water on a warm, breezy day, he experiences a cooling effect. Why?\",\"src\":\"stemez-Chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}