{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"82baed34-6623-55e4-b792-7dfb82f53a5c","task_key":"default--test--2894","task_revision_id":"1","upstream_id":"2894","short_description":"The percentage of successful single pairmatingsobserved forone hour in…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Wild-type females are less successful in mating with yellow males.', 'The males with the yellow mutation are less successful in mating with wild-type gray females than are wild-type males.', 'Yellow females prefer to mate with yellow males, leading to higher success rates.', 'Wild-type males preferentially mate with yellow females, increasing success rates.', 'Wild-type males are less successful in mating with yellow females', 'The mutation leads to increased aggression in males, reducing mating success.', 'Yellow mutation does not affect mating behavior', 'The yellow mutation enhances the attractiveness of both males and females, leading to higher mating success rates.', 'Yellow mutation increases the success rate of mating']\",\"question\":\"The percentage of successful single pairmatingsobserved forone hour in Drosophilamelanogastercultures showed thefollowing: Matings Before crossing wild stock with yellow stock for 7generations After crossing wild stock with yellow stock for 7generations WT male × WT female 62 75 Yellow male × WT female 34 47 WT male × yellow female 87 81 Yellow male × yellow female 78 59 Yellow is a recessive mutant strain of flies that is phenotypicallyexpressed as a yellow rather than gray body. Explain how this mutation affects the mating behavior of D.melanogaster.\",\"src\":\"stemez-Genetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}