{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"706d83f6-b4d8-5384-993b-cfe4078cb8a3","task_key":"default--test--3288","task_revision_id":"1","upstream_id":"3288","short_description":"If two fruit flies, heterozygous for genes of one allelic pair, were bred…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['100, complementation test', '200, self cross', '175, self cross', '150, reciprocal cross', '50, test cross', '125, back cross', '150, inbreeding', '75, pedigree analysis', '150, test cross', '100, back cross']\",\"question\":\"If two fruit flies, heterozygous for genes of one allelic pair, were bred together and had 200 offspring... (a) about how many would have the dominant phenotype? (b) of these offspring, some will be homozygous dominant and some heterozygous. How is it possible to establish which is which?\",\"src\":\"stemez-Genetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}