{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c0df6d08-97db-5f86-a952-875630329a07","task_key":"default--test--2056","task_revision_id":"1","upstream_id":"2056","short_description":"When an adult mouse or bird is castrated, its sexual behavior virtually…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['In higher primates such as man, castration does not affect the ability to perform the sexual act, provided the male is sexually mature and experienced.', 'In primates, castration after sexual maturity reduces aggression but has no effect on sexual behavior.', 'Primates show a temporary decline in sexual behavior post-castration, but it fully recovers within weeks.', 'Castration in primates results in complete loss of sexual behavior', 'Castration in primates has no effect on their sexual behavior at any stage of development.', 'Castration of primates leads to an increase in sexual behavior due to hormonal imbalances.', 'Castration affects the ability to perform sexual acts in all animals', \\\"Primates can't learn sexual behavior through experience\\\", 'Castration of primates causes a permanent shift to non-sexual social behavior patterns.', 'In higher primates, castration before puberty prevents the development of sexual behavior entirely.']\",\"question\":\"When an adult mouse or bird is castrated, its sexual behavior virtually disappears. Compare the effects of castration of highly developed primates with the less developed animals.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}