{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"09db0890-fcd9-5cc4-8e49-101cd37a1c5a","task_key":"default--test--5300","task_revision_id":"1","upstream_id":"5300","short_description":"The onset (the very beginning) of labor is first triggered by","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"[\\\"hormones secreted by the Mother's thyroid gland\\\", \\\"hormones secreted by the Mother's hypothalamus\\\", \\\"hormones secreted by the fetus' adrenal gland\\\", \\\"hormones secreted by the Mother's adrenal gland\\\", 'the placenta and uterus secretion of prostaglandins', \\\"hormones secreted by the Mother's pituitary gland\\\", 'the placenta and uterus secretion of oxytocin', 'the placenta and uterus secretion of estrogens', \\\"hormones secreted by the fetus' pituitary gland\\\", \\\"hormones secreted by the Mother's ovaries\\\"]\",\"question\":\"The onset (the very beginning) of labor is first triggered by\",\"src\":\"ori_mmlu-human_sexuality\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}