{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e2d36ddb-50e1-5962-84a9-e57e84fcf4e7","task_key":"default--test--6712","task_revision_id":"1","upstream_id":"6712","short_description":"What happens during the 'incubation period'?","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['The virus mutates and becomes more virulent', 'This period commonly lasts for a few hours', 'Virus replication happens at an intracellular level', 'Symptoms of the disease start appearing in the host', 'The virus is spread to others without any symptoms in the host', \\\"The host's body becomes immune to the virus\\\", 'The virus is cleared from the body by the immune system', 'This period commonly lasts for a few years', 'The virus is dormant and does not replicate']\",\"question\":\"What happens during the 'incubation period'?\",\"src\":\"ori_mmlu-virology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}