{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fd1c731f-48aa-5798-a5d5-de10ea475ea0","task_key":"default--test--6420","task_revision_id":"1","upstream_id":"6420","short_description":"The major concentrations of proprioceptive receptors providing information about…","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['the articular disc of the TMJ and the lateral pterygoid muscle.', 'the capsule and ligaments of the TMJ and the masseter muscle.', 'the ligaments of the TMJ and the medial pterygoid muscle.', 'the articular disc of the TMJ and the medial pterygoid muscle.', 'the articular disc of the TMJ and the medial and lateral pterygoid muscles.', 'the capsule, ligaments, and articular disc of the TMJ.', 'the articular disc of the TMJ and the masseter muscle.', 'the capsule and ligaments of the TMJ and the lateral pterygoid muscle.', 'the capsule and ligaments of the TMJ and the medial pterygoid muscle.', 'the capsule of the TMJ and the lateral pterygoid muscle.']\",\"question\":\"The major concentrations of proprioceptive receptors providing information about position of the TMJ are located in\",\"src\":\"ori_mmlu-anatomy\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}