{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5f63e17f-a76c-56e9-a750-1725264f8938","task_key":"default--test--2895","task_revision_id":"1","upstream_id":"2895","short_description":"Consider the ABO blood group locus in humans, which has six (6) alleles reported…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['the daughter of blood group O', 'The son with A blood type', 'the son of blood group O', 'the daughter who has blood group A', 'None of the children are adopted; a genetic mutation occurred', 'The daughter with AB blood type', 'the son who has B blood type', 'The son with AB blood type', 'The daughter with B blood type', 'The child with a rare blood type not listed']\",\"question\":\"Consider the ABO blood group locus in humans, which has six (6) alleles reported for it, of which three are most prominent, I^A, I^B andi. The I^A and I^B alleles are both dominant toiandcodominantto each other. A woman of blood group O marries a man who has blood group B. There are four children in the family: a son and daughter of blood group O; a daughter who has A blood type; and a son who has B blood type. One of the children is adopted. Which child is the adopted child?\",\"src\":\"stemez-Genetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}