{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"88cdcf9a-98ba-5e16-9283-fbcd45842a7a","task_key":"default--test--2461","task_revision_id":"1","upstream_id":"2461","short_description":"Which of the following best states why the study of twins is significant to the…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['If a psychological attribute is genetically influenced, then fraternal twins are more likely to share this attribute than are identical twins or other siblings.', 'The degree of relatedness in MZ twins can be determined through studying the behavioral genetics of related DZ twins.', 'The degree of relatedness in DZ twins can be determined through studying the behavioral genetics of unrelated MZ twins.', 'If a psychological attribute is genetically influenced, then non-twin siblings are more likely to share this attribute than are identical or fraternal twins.', 'If a psychological attribute is not genetically influenced, then identical twins are less likely to share this attribute than are fraternal twins and other siblings.', 'If a psychological attribute is genetically influenced, then fraternal twins reared apart are more likely to share this attribute than are identical twins reared together.', 'If a psychological attribute is genetically influenced, then identical twins reared apart are less likely to share this attribute than are fraternal twins reared together.', 'If a psychological attribute is genetically influenced, then identical twins are more likely to share this attribute than are fraternal twins and other siblings.', 'If a psychological attribute is genetically influenced, then siblings reared together are more likely to share it than are identical or fraternal twins who are reared apart.', 'If a psychological attribute is not genetically influenced, then fraternal twins are more likely to share this attribute than are identical twins or other siblings.']\",\"question\":\"Which of the following best states why the study of twins is significant to the field of behavioral genetics?\",\"src\":\"ori_mmlu-high_school_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}