{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a126fc0a-2620-50cb-a996-b0b36d8fa9ab","task_key":"default--test--6673","task_revision_id":"1","upstream_id":"6673","short_description":"An investigator is studying the incidence of the common cold among medical…","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Increased AM serum cortisol concentration', 'Increased eosinophil count', 'Decreased neutrophil count', 'Decreased AM serum cortisol concentration', 'Decreased basophil count', 'Increased basophil count', 'Increased lymphocyte count', 'Decreased lymphocyte count', 'Increased macrophage activity', 'Decreased macrophage activity']\",\"question\":\"An investigator is studying the incidence of the common cold among medical students at various time points during the school year. Results show an increased incidence of upper respiratory tract infections among these students during finals week. It is hypothesized that the stress of studying for examinations adversely affects the immune system, making the students more susceptible to infection. Which of the following laboratory findings in these students during examination week is most likely to support this hypothesis? \",\"src\":\"ori_mmlu-professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}