{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c35cfb90-80a3-5a42-901b-92761ff4fb68","task_key":"default--test--6222","task_revision_id":"1","upstream_id":"6222","short_description":"Which one of the following statements about the growth of the mandible is…","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['The functional matrix acting on the angle of the mandible is the medial pterygoid muscle', 'The mental symphysis never fully closes', \\\"The ossification centre appears about 8 weeks I.U.L medial to Meckel's cartilage\\\", 'The mandibular foramen shifts position during growth', 'The condylar growth cartilage ceases activity at puberty', \\\"The ossification centre appears about 12 weeks I.U.L medial to Meckel's cartilage\\\", 'The functional matrix acting on the angle of the mandible is the lateral pterygoid muscle', 'The condylar growth cartilage remains active throughout life', 'The mandible stops growing at the onset of adolescence', 'The mental symphysis closes at about 1 year postnatally']\",\"question\":\"Which one of the following statements about the growth of the mandible is correct?\",\"src\":\"ori_mmlu-anatomy\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}