{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cb16db28-3e9a-58b3-8603-464082057e83","task_key":"default--test--2951","task_revision_id":"1","upstream_id":"2951","short_description":"In Japan, the frequency of the R-governed multiple drug-resistant strain…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The bacteria developed immunity to antibiotics', 'The bacteria were genetically modified', 'Transfer of resistance genes from non-pathogenic to pathogenic bacteria through horizontal gene transfer', 'A decline in vaccination rates leading to increased bacterial spread', 'Over-prescription of antibiotics in livestock agriculture leading to cross-species transfer of resistance', 'Natural selection favored bacteria that were inherently resistant to antibiotics', 'The bacteria mutated rapidly', 'Increased use of antibacterial soaps and disinfectants in hospitals', 'Introduction of new antibiotics that were less effective against resistant strains', 'Indiscriminate use of antibiotics selected for drug-resistant bacteria which can then pass their resistance to potentially harmful strains.']\",\"question\":\"In Japan, the frequency of the R-governed multiple drug-resistant strain ofShigella, which causes dysentery, rose from 0.2 percent in 1953 to 58 percent in 1965. Also, 84 percent of the E. coli and 90 percent of Proteus collected from affected hospital patients showed similar resistance. How could such an increase happen?\",\"src\":\"stemez-Genetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}