{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"26fd71da-ba04-5b93-a5c9-5de10fb92531","task_key":"default--test--2816","task_revision_id":"1","upstream_id":"2816","short_description":"Tay-Sachs is a disease caused by a recessive allele. Individuals with the…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Occasionally the gene will instead increase the fitness of the individual.', 'Tay-Sachs is asymptomatic in people who are homozygous recessive.', 'The recessive allele is actually beneficial in certain environments.', 'The disease increases the fertility of those who carry it.', 'Tay-Sachs is a dominant disease, so carriers will show symptoms.', 'Spontaneous mutation converts the dominant allele to the recessive form.', 'Heterozygous individuals will show no symptoms.', 'The gene for Tay-Sachs also provides resistance to another disease.', 'The disease can be cured, so individuals with the disorder are able to reproduce.', 'The allele is not preserved and is actually decreasing in frequency.']\",\"question\":\"Tay-Sachs is a disease caused by a recessive allele. Individuals with the genetic disorder usually do not survive more than a few years, and thus are not able to reproduce and pass on the gene. What would explain how this allele and its associated disease is preserved in the population?\",\"src\":\"ori_mmlu-high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}