{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d2661e2b-833a-512d-a6aa-a9f72253c6fd","task_key":"default--test--3405","task_revision_id":"1","upstream_id":"3405","short_description":"Are there comparable changes, in the male, to female menopause?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Males experience a temporary pause in reproductive function, which fully recovers after a few years', 'Males undergo a sudden increase in fertility at an age comparable to female menopause', 'No complete cessation of reproductive function in males analogous to female menopause', 'Testosterone levels in males increase to peak levels in their later life, similar to a reverse menopause', 'Males face a complete and permanent stop in the production of all reproductive hormones at a certain age', 'Testosterone levels sharply drop in males in their later life', 'Dramatic changes occur in males similar to female menopause', 'Males have a gradual increase in reproductive hormones during middle age', 'Males experience a well-defined period known as andropause, which is identical to menopause', 'Males also experience menopause']\",\"question\":\"Are there comparable changes, in the male, to female menopause?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}