{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c0c3a799-a374-59f4-9875-9a26e73eeb3e","task_key":"default--test--3236","task_revision_id":"1","upstream_id":"3236","short_description":"\"The ovule of a rose is analogous to the capsule of a moss.\" Explain what is…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The ovule of a rose and the capsule of a moss are identical in function.', 'The ovule of a rose produces spores that do not require fertilization, while the capsule of a moss produces spores that do.', 'The capsule of a moss is the female reproductive part, while the ovule of a rose is the male reproductive part.', 'The ovule of a rose gives rise to bisexual gametophytes.', 'The capsule of a moss produces only male spores.', 'The ovule of a rose and the capsule of a moss differ in that the ovule produces only those spores which will develop into female gametophytes, while the capsule produces spores which will give rise to bisexual gametophytes.', 'The capsule of a moss contains seeds, while the ovule of a rose contains spores.', 'The ovule of a rose is involved in sexual reproduction, while the capsule of a moss is not.', 'The ovule of a rose is part of the gametophyte generation, while the capsule of a moss is part of the sporophyte generation.', 'The capsule of a moss disperses pollen, which is similar to the role of the ovule in a rose.']\",\"question\":\"\\\"The ovule of a rose is analogous to the capsule of a moss.\\\" Explain what is wrong with this statement.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}