{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0c4a5019-3500-5f2d-b790-c20cc8bee78a","task_key":"default--test--3318","task_revision_id":"1","upstream_id":"3318","short_description":"Why would you not expect conjugation among a group of paramecia that had…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Conjugation is prevented by the presence of a dominant allele', 'Conjugation results in lesser genetic diversity', 'Conjugation can occur among identical organisms', 'All individuals are identical genetically, and conjugation could not occur.', 'Conjugation does not require different mating types', 'Conjugation among paramecia is limited by their lifecycle and can only happen at certain stages', 'Paramecia are incapable of conjugation due to their single-celled nature', 'Conjugation is a form of reproduction that results in genetically identical offspring', 'Conjugation requires a special organ that paramecia do not possess', 'Conjugation only occurs in stressful environmental conditions']\",\"question\":\"Why would you not expect conjugation among a group of paramecia that had descended from a single individual through repeated fission?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}