{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fcc54ef2-cc02-5852-9b57-cc4e3a10e343","task_key":"default--test--6672","task_revision_id":"1","upstream_id":"6672","short_description":"An investigator is studying the incidence of the common cold among medical…","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Decreased lymphocyte count', 'Decreased basophil count', 'Decreased macrophage activity', 'Increased AM serum cortisol concentration', 'Increased macrophage activity', 'Decreased neutrophil count', 'Decreased AM serum cortisol concentration', 'Increased eosinophil count', 'Increased lymphocyte count', 'Increased basophil count']\",\"question\":\"An investigator is studying the incidence of the common cold among medical students at various time points during the school year. Results show an increased incidence of upper respiratory tract infections among these students during finals week. It is hypothesized that the stress of studying for examinations adversely affects the immune system, making the students more susceptible to infection. Which of the following laboratory findings in these students during examination week is most likely to support this hypothesis?\",\"src\":\"ori_mmlu-professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}