{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7a60f314-3b2e-5de2-998f-f6efd89d7d0b","task_key":"default--test--2878","task_revision_id":"1","upstream_id":"2878","short_description":"What advantages do microorganisms have over largerforms of life as subjects for…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Microorganisms are prime experimental subjects for genetic investigation due to their extremely rapid rate of reproduction, large populations, cost-effectiveness, and simplicity of their genetic material and metabolism.', 'Microorganisms are more complex than larger forms of life.', 'Microorganisms are larger in size, which makes the manipulation of their genetic material easier.', 'Microorganisms have more genes than larger organisms, providing a more comprehensive understanding of genetics.', 'Microorganisms require more space and resources for cultivation, which is beneficial for large-scale genetic experiments.', 'Microorganisms are less susceptible to genetic mutations, ensuring more consistent experimental results.', 'Microorganisms are difficult to breed and reproduce.', 'Microorganisms can be easily observed in their natural habitats, making them ideal for genetic studies.', 'Microorganisms have no advantage over larger forms of life.', 'Microorganisms offer the ability to study long-term evolutionary processes within short time frames due to their longevity.']\",\"question\":\"What advantages do microorganisms have over largerforms of life as subjects for genetic investigation?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}