{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f287ee28-5931-5f4a-b91e-7497f02eea23","task_key":"default--test--9578","task_revision_id":"1","upstream_id":"9578","short_description":"Six simple harmonic motions, each of the same amplitude and period, acting along…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['120 degrees', '90 degrees', '75 degrees', '180 degrees', '210 degrees', '60 degrees', '45 degrees', '30 degrees', '135 degrees', '150 degrees']\",\"question\":\"Six simple harmonic motions, each of the same amplitude and period, acting along the same straight line, are superimposed. If the phase difference between each successive pair is the same, find one value of this phase difference for which the resultant amplitude is zero.\",\"src\":\"stemez-Optics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}