{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c69871b1-0c3c-57f9-a7fe-ae1d4a92a28e","task_key":"default--test--2952","task_revision_id":"1","upstream_id":"2952","short_description":"How do bacteria develop drug resistance?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Antibiotic resistance arises from bacteria absorbing nutrients that counteract the drug', 'Resistance develops due to prolonged exposure to antibiotics', 'Bacteria develop a natural immunity to drugs over time', 'Bacteria develop resistance through spontaneous generation without exposure to antibiotics', 'Drug resistance is caused solely by the use of antibacterial hand sanitizers', 'Bacteria communicate with each other to share resistance traits', 'Resistance is a result of antibiotics triggering the immune system to protect bacteria', 'Most antibiotic resistant bacteria result from genetic changes and subsequent selection due to chromosomal mutations or the introduction of extra chromosomal elements.', 'Drug resistance is passed on from parent bacteria to offspring', 'Drug resistance occurs when bacteria mutate due to exposure to non-antibiotic chemicals only']\",\"question\":\"How do bacteria develop drug resistance?\",\"src\":\"stemez-Genetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}