{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c9d91a3e-578f-5a62-99cd-6e37fec4d92f","task_key":"default--test--3245","task_revision_id":"1","upstream_id":"3245","short_description":"A biology student observes filamentous appendages on a bacterium and concludes…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The appendages are actually cilia', 'The appendages are vestigial structures from an evolutionary ancestor', 'The filamentous appendages are not flagella, but pili (or fimbriae).', 'The student is observing a form of spore or reproductive structure, not related to motility', 'The appendages are microvilli used for adhesion or nutrient absorption, not movement', 'The bacterium is actually motile', 'The bacterium uses a different method of motility not involving flagella', 'The appendages are flagella but they are non-functional', 'The appendages are a form of sensory organelles, not involved in movement', 'The flagella are operational, but the bacterium is in a dormant state']\",\"question\":\"A biology student observes filamentous appendages on a bacterium and concludes they are flagella. However, he is told that the bacterium is non-motile. He therefore concludes that the flagella are non-operational. Why are both ofhis conclusions incorrect?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}