{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b7651ba8-84ea-51ed-9f8a-1d4d7f407304","task_key":"default--test--3192","task_revision_id":"1","upstream_id":"3192","short_description":"What are the bacterial factors influencing virulence?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Bacterial size and shape', 'Presence of capsule and type of cell wall', 'Bacterial flagellar length and number of pili', 'Production of toxins, ability to enter the host and penetrate host tissue, and ability to resist destruction by the host', 'Ability to form spores and gas production', 'Bacterial color and movement', 'Temperature and pH levels', 'Nutrient acquisition and waste product secretion', 'Bacterial genome size and plasmid content', 'Bacterial communication methods and growth rate']\",\"question\":\"What are the bacterial factors influencing virulence?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}