{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c3a92920-3920-564e-9be0-24c84fc522de","task_key":"default--test--3300","task_revision_id":"1","upstream_id":"3300","short_description":"One group of compounds that may become quite important in birth control is the…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Prostaglandins are used to enhance mood and have no effect on birth control.', 'Prostaglandins increase fertility by promoting ovulation.', 'Prostaglandins are able to prevent pregnancy by altering the DNA of the sperm and egg.', 'Prostaglandins are known to mediate hormonal action', 'Prostaglandins are non-hormonal, reducing the risk of hormonal side effects.', 'Prostaglandins can be taken orally once a month, providing long-term birth control.', 'Prostaglandins are cyclic, oxygenated, 20-carbon fatty acids', 'Prostaglandins induce strong contractions in the uterus, prevent the fertilized ovum from being implanted, and can be introduced directly into the uterus, making them potentially safer contraceptives than oral chemical agents.', 'Prostaglandins improve skin condition and are used as a beauty supplement.', 'Prostaglandins are efficient in treating nasal congestion']\",\"question\":\"One group of compounds that may become quite important in birth control is the prostaglandins. What are the advantages of prostaglandins in birth control?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}