{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b76b1c4d-b824-5243-aaaa-e3b8b76cf7f4","task_key":"default--test--3523","task_revision_id":"1","upstream_id":"3523","short_description":"Why would you not expect conjugation among a group of paramecia that had…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['conjugation results in no genetic diversity', 'conjugation requires more than two organisms', 'all individuals are identical genetically, and conjugation could not occur', 'repeated fission in paramecia results in sterile offspring that cannot conjugate', 'the group of paramecia lacks the cellular structures necessary for conjugation', 'conjugation is only possible in the presence of a specific chemical signal absent in this group', 'conjugation is prevented by the environmental conditions in which the paramecia live', 'conjugation can occur regardless of genetic similarities', 'paramecia descended from a single individual are incapable of conjugation due to a mutation', 'conjugation only occurs at a specific time of year which has not yet arrived']\",\"question\":\"Why would you not expect conjugation among a group of paramecia that had descended from a single individual through repeated fission?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}