{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"88540322-ec4d-5e5e-b639-27cd76694068","task_key":"default--test--2825","task_revision_id":"1","upstream_id":"2825","short_description":"The frequency of the gene for sickle-cell anemia in African-Americans is less…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Sickle-cell disease is more deadly in America', 'Sickle-cell disease has been completely eradicated in America', 'The sickle-cell gene mutates at a lower rate in America', 'Genetic drift has led to a decrease in the frequency of the sickle-cell gene in African-Americans', 'Increased medical intervention in America allows individuals with sickle-cell disease to live longer and reproduce more', 'There is no difference in the frequency of the sickle-cell gene between African-Americans and their African ancestors', 'In America, the incidence of malaria is insignificant, sickle-cell genes are being diluted by normal genes and interracial marriages.', 'There is a higher survival rate for sickle-cell carriers in America', 'Sickle-cell allele is more dominant in Africa', 'The sickle-cell allele is being actively selected against in the African-American population']\",\"question\":\"The frequency of the gene for sickle-cell anemia in African-Americans is less than that found in the people living in their ancestral home in Africa. What factors might account for this difference?\",\"src\":\"stemez-Genetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}