{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"36628bf9-2504-571c-9e8e-eb5c74f29b41","task_key":"default--test--3279","task_revision_id":"1","upstream_id":"3279","short_description":"Distinguish between copulation, insemination and fertilization.","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Copulation is the act of physical joining of two sex partners, insemination is the process of depositing semen into the vagina, and fertilization is the union of the male and female gametes to produce the zygote.', 'Copulation is the process of depositing semen, insemination is the union of the sperm and egg, and fertilization is the act of physical joining.', 'Fertilization is the act of physical joining of two sex partners, insemination is the union of male and female gametes, and copulation is the process of depositing semen into the reproductive tract.', 'Insemination is the act of physical joining, fertilization is the union of male and female gametes, and copulation is the process of depositing semen into the vagina.', 'Copulation is the union of male and female gametes, insemination is the act of physical joining, and fertilization is the process of depositing semen.', 'Fertilization is the act of physical joining, insemination is the process of depositing semen, and copulation is the union of the male and female gametes.', 'Fertilization is the process of depositing semen, copulation is the union of the sperm and egg, and insemination is the act of physical joining of two sex partners.', 'Insemination is the act of physical joining, copulation is the process of depositing semen, and fertilization is the union of the sperm and egg.', 'Copulation is the process of depositing semen, insemination is the act of physical joining, and fertilization is the union of the sperm and egg within the vagina.', 'Insemination is the union of the sperm and egg, copulation is the union of male and female gametes, and fertilization is the act of physical joining.']\",\"question\":\"Distinguish between copulation, insemination and fertilization.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}