{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"405d3033-5a65-5fb7-a207-023057a9a08c","task_key":"default--test--6789","task_revision_id":"1","upstream_id":"6789","short_description":"Which of one of the following statements about the postnatal growth of the…","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['The maxilla stops growing after the eruption of permanent teeth', 'Pneumatisation by enlargement of the developing maxillary sinus ceases at puberty', 'Space is created for the eruption of the permanent molars by resorption of the maxillary tuberosity', 'The intermaxillary suture closes immediately after birth', 'The intermaxillary suture closes about eight years postnatally', 'The maxillary sinus decreases in size postnatally', 'Space for the eruption of the permanent molars is created by enlargement of the maxillary sinus', 'The zygomaticomaxillary sutures contribute to increase in height and length of the maxilla', 'The zygomaticomaxillary sutures do not contribute to the growth of the maxilla', 'The maxilla does not grow postnatally']\",\"question\":\"Which of one of the following statements about the postnatal growth of the maxilla is correct?\",\"src\":\"ori_mmlu-anatomy\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}