{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9a6f811f-d1e9-51f2-b3a1-48072ab02493","task_key":"default--test--10165","task_revision_id":"1","upstream_id":"10165","short_description":"A rock drops onto a pond with a smooth surface. A few moments later, the wave…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['The wave has become more turbulent.', 'The wave has split into multiple smaller waves.', 'The wave pulse’s width has become greater.', \\\"The wave's height has become greater.\\\", 'The wave is moving more slowly.', 'The wave pulse’s width has become smaller.', \\\"The wave's speed has increased.\\\", 'The wave’s height has become smaller.', 'The temperature of the water has changed.', \\\"The wave's color has changed.\\\"]\",\"question\":\"A rock drops onto a pond with a smooth surface. A few moments later, the wave produced by the rock’s impact arrives at the shore, touching the ankles of a wading child. Which of the following observations provides evidence that the portion of the wave hitting the child’s ankles carries less energy than the wave did when it was first created by the rock’s impact?\",\"src\":\"ori_mmlu-high_school_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}