{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fbad0a39-ff27-5d4c-8a5e-20cdadaea082","task_key":"default--test--3282","task_revision_id":"1","upstream_id":"3282","short_description":"Both Mr. and Mrs. Brown suffer from anautosomalrecessive condition that makes…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Only one parent can pass the disorder to the children', 'Both parents will definitely pass the disorder to their children', 'Both children inherited a different form of anemia that is not detectable at their current age.', 'Both parents have a homozygous trait but may or may not pass the disorder to their children', 'The children cannot be carriers since they are not anemic.', 'The children have a 50% chance of being carriers and a 25% chance of being affected.', 'The disorder can only be inherited from the mother.', 'Neither of the parents can pass the disorder to their children', 'The children are anemic but show no symptoms due to a modifier gene.', 'Each child will inherit the disorder, but it will remain dormant until adulthood.']\",\"question\":\"Both Mr. and Mrs. Brown suffer from anautosomalrecessive condition that makes them anemic. Mr. Brown has one amino acid substitution in the \\\\beta-chain of his hemoglobin molecules and Mrs. Brown has a similar defect in her \\\\alpha-chain. Neither Betsy norBoopsy, their children, are anemic. Explain.\",\"src\":\"stemez-Genetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}