{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8555b11d-39fa-542a-928f-e8a0308f1932","task_key":"default--test--2888","task_revision_id":"1","upstream_id":"2888","short_description":"What evolutionary advanced features are present in Selaginella but not in the…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Presence of vessels in both xylem and phloem, autospory, reduced and independent gametophyte, embryo without a suspensor', 'Heterospory, independent gametophyte, absence of vessels in xylem, embryo with multiple suspensors', 'Autospory, dependent gametophyte, presence of vessels in phloem, embryo with a cotyledon', 'Homospory, independent gametophyte, absence of vessels in xylem, embryo without suspensor', 'Homospory, reduced and dependent gametophyte, presence of vessels in phloem, embryo equipped with a suspensor', 'Heterospory, independent gametophyte, presence of vessels in xylem, embryo with cotyledon', 'Homospory, independent gametophyte, presence of vessels in xylem, embryo without suspensor', 'Homospory, reduced and dependent gametophyte, presence of vessels in both xylem and phloem, embryo without suspensor', 'Autospory, reduced and dependent gametophyte, absence of vessels in xylem, embryo with a cotyledon', 'Presence of vessels in xylem, reduced and dependent gametophyte, heterospory, and embryo equipped with a suspensor']\",\"question\":\"What evolutionary advanced features are present in Selaginella but not in the ferns?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}