{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"42fd5f4a-d130-5d79-903d-8fa0883779fb","task_key":"default--test--6421","task_revision_id":"1","upstream_id":"6421","short_description":"On which surfaces of the teeth is dental plaque most likely to accumulate in the…","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['The palatal surfaces of the upper molars and buccal surfaces of the lower incisors.', 'The buccal surfaces of the upper molars and labial surfaces of the lower incisors.', 'The buccal surfaces of the upper molars and palatal surfaces of the lower incisors.', 'The buccal surfaces of the upper molars and lingual surfaces of the lower incisors.', 'The labial surfaces of the upper molars and buccal surfaces of the lower incisors.', 'The labial surfaces of the upper molars and palatal surfaces of the lower incisors.', 'The palatal surfaces of the upper molars and labial surfaces of the lower incisors.', 'The palatal surfaces of the upper molars and lingual surfaces of the lower incisors.', 'The lingual surfaces of the upper molars and palatal surfaces of the lower incisors.', 'The lingual surfaces of the upper molars and labial surfaces of the lower incisors.']\",\"question\":\"On which surfaces of the teeth is dental plaque most likely to accumulate in the mouth of a patient with poor oral hygiene?\",\"src\":\"ori_mmlu-anatomy\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}