{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3117deb7-9e06-562b-9d9d-b06bd584c2ee","task_key":"default--test--2430","task_revision_id":"1","upstream_id":"2430","short_description":"Briefly describe the process of labor.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Labor is a routine medical check-up schedule during pregnancy', 'Labor is the process of fetal development', 'Labor is the healing period after the baby has been delivered', 'Labor is the time frame in which a mother experiences morning sickness', \\\"Labor is the process where the mother's body prepares for conception\\\", 'Labor is the period of gestation', \\\"Labor occurs when the fetus, placenta, and other membranes, are separated from and expelled from the mother's body\\\", \\\"Labor is the term for the baby's movements felt by the mother during the second trimester\\\", 'Labor is the process of the fetus growing and maturing in the womb over several weeks', 'Labor is the act of conceiving a child']\",\"question\":\"Briefly describe the process of labor.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}