{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"04a8395c-7958-589c-8609-4b94a3614b04","task_key":"default--test--9599","task_revision_id":"1","upstream_id":"9599","short_description":"Show how two clocks, one at the origin and the other a dis-tance d from the…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['The other clock should be pre-set to the current time, assuming instantaneous signal travel time from the origin', 'The other clock should be synchronized using sound waves instead of light', 'The other clock should be pre-set to the current time minus d/c', \\\"The other clock should be pre-set so that it reads 12:00 o'clock plus d/c\\\", 'The other clock should be pre-set so that it reads d/c past the time on the origin clock', \\\"The other clock should be pre-set to exactly 12:00 o'clock\\\", 'The other clock should be pre-set to an arbitrary time unrelated to the origin clock and distance d', 'The other clock should be pre-set so that it reads the current time minus the time it takes light to travel distance d']\",\"question\":\"Show how two clocks, one at the origin and the other a dis-tance d from the origin, may be synchronized.\",\"src\":\"stemez-Physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}