{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5712a283-7bec-5ff6-9599-9ba15462294b","task_key":"default--test--3104","task_revision_id":"1","upstream_id":"3104","short_description":"Mosquitoes resistant to the pesticide DDT first appeared in India in 1959 within…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The mosquitoes reproduced at such a fast rate that they evolved to become resistant to DDT.', 'Although DDT is effective against a wide range of insects, it is not effective against mosquitoes.', 'Some mosquitoes experienced a mutation after being exposed to DDT that made them resistant to the insecticide. Then their population expanded because these moquitoes had no competition.', 'The mosquitoes developed a resistance because the DDT used was of a lesser concentration.', 'The mosquitoes developed a resistance to DDT over time due to constant exposure.', 'DDT is generally a very effective insecticide. One can only conclude that it was manufactured improperly.', 'The resistant mosquitoes were imported from a different area where DDT was not used.', 'All the mosquitoes were initially resistant to DDT, but the resistant ones were better at surviving.', 'Some mosquitoes were already resistant to DDT when DDT was first sprayed. Then their population expanded because all the susceptible mosquitoes had been exterminated.', 'The mosquitoes were initially resistant to DDT, but due to a mutation, they lost their resistance.']\",\"question\":\"Mosquitoes resistant to the pesticide DDT first appeared in India in 1959 within 15 years of widespread spraying of the insecticide. Which of the following statement best explains how the resistant mosquitoes arose?\",\"src\":\"ori_mmlu-high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}