{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bbc6336e-e4db-57e3-a93e-7a1070247d45","task_key":"default--test--3202","task_revision_id":"1","upstream_id":"3202","short_description":"Which of the following principles is NOT part of Darwin's theory of evolution by…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"[\\\"Evolution does not occur within an individual's lifespan.\\\", 'Natural selection favors traits that are beneficial for survival.', 'Evolution occurs in response to changes in the environment.', 'Every population has tremendous variation.', 'Species can develop new traits during their lifetime, which they can pass on to their offspring.', 'Survival of the fittest ensures that only the strongest survive.', 'Evolution is a gradual process that occurs over a long period of time.', 'Every species has the potential to evolve.', 'Organisms will overpopulate area, giving rise to competition.', 'Mutations are the main source of all variation in a population.']\",\"question\":\"Which of the following principles is NOT part of Darwin's theory of evolution by natural selection?\",\"src\":\"ori_mmlu-high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}