{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"40a7dc75-2e6b-5dc1-9ceb-40a95cc7bc72","task_key":"default--test--6300","task_revision_id":"1","upstream_id":"6300","short_description":"Which of the following statements is true of the temporomandibular joint?","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['It has an articular disc of fibrocartilage', 'Proprioceptive information is carried by the chorda tympani and deep temporal nerves', 'It is a hinge type of synovial joint', 'Proprioceptive information is carried by the masseteric and auriculotemporal nerves.', 'Proprioceptive information is carried by the glossopharyngeal and vagus nerves.', 'Its articular surfaces are covered by hyaline cartilage', 'Its articular surfaces are covered by fibrocartilage', 'Proprioceptive information is carried by the facial and trigeminal nerves', 'It has an articular disc of hyaline cartilage', 'It is a pivot type of synovial joint']\",\"question\":\"Which of the following statements is true of the temporomandibular joint?\",\"src\":\"ori_mmlu-anatomy\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}