{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4aaacf77-eb0c-5eb9-a021-828ea43e7ade","task_key":"default--test--3156","task_revision_id":"1","upstream_id":"3156","short_description":"The same gene that causes various coat patterns in wild and domesticated cats…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Genetic mutations causing the coat pattern are more likely to occur in this population.', 'Natural selection always results in the elimination of maladaptive traits.', 'Polygenic inheritance is generally maladaptive, and should become less common in future generations.', 'This scenario disproves the theory of evolution.', 'The cross-eyed condition is actually an adaptive trait in this environment.', 'The coat pattern gene and the cross-eyed condition gene are separate and unrelated.', 'Phenotype is often the result of compromise.', 'Evolution is progressive and tends toward a more perfect population.', 'Natural selection reduces the frequency of maladaptive genes in populations over the course of time.', 'The cross-eyed condition will eventually disappear from the population as it is maladaptive.']\",\"question\":\"The same gene that causes various coat patterns in wild and domesticated cats also causes the cross-eyed condition in these cats, the cross-eyed condition being slightly maladaptive. In a hypothetical environment, the coat pattern that is associated with crossed eyes is highly adaptive, with the result that both the coat pattern and the cross-eyed condition increase in a feline population over time. Which statement is supported by these observations?\",\"src\":\"ori_mmlu-high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}