{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a985d7d1-d8a3-5463-9044-a57c4b432d23","task_key":"default--test--2615","task_revision_id":"1","upstream_id":"2615","short_description":"Which of the following statements expresses a relationship between aging and…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Aging is related to an increase in vaginal lubrication', 'Aging is associated with a decrease in the frequency and number of orgasmic contractions in both sexes', 'Aging is related to an increase in sexual performance in the male', 'Aging is associated with an increase in sexual drive in both sexes', 'Aging is related to an improvement in sexual stamina in both sexes', 'Aging is related to some loss of erectile rigidity in the male', 'There is a direct correlation between aging and an increase in fertility in both sexes', 'Aging is associated with an increase in the frequency and number of orgasmic contractions in both sexes', 'There is no significant relationship between aging and sexual responses in either sex']\",\"question\":\"Which of the following statements expresses a relationship between aging and sexual functioning\",\"src\":\"ori_mmlu-professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}