{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"97736a76-b83d-51ca-9b87-7b3e436a45bd","task_key":"all--test--97736a76-b83d-51ca-9b87-7b3e436a45bd","task_revision_id":"1","upstream_id":"","short_description":"Which of the following best states why the study of twins is significant to the…","config":"all","split":"test","body":"{\"choices\":\"['If a psychological attribute is genetically influenced, then fraternal twins are more likely to share this attribute than are identical twins or other siblings.', 'If a psychological attribute is genetically influenced, then siblings reared together are more likely to share it than are identical or fraternal twins who are reared apart.', 'The degree of relatedness in MZ twins can be determined through studying the behavioral genetics of related DZ twins.', 'If a psychological attribute is genetically influenced, then identical twins are more likely to share this attribute than are fraternal twins and other siblings.']\",\"question\":\"Which of the following best states why the study of twins is significant to the field of behavioral genetics?\",\"subject\":\"high_school_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}