{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d0f0b5d1-a97e-5f6d-a76f-42be3fef8935","task_key":"default--test--2557","task_revision_id":"1","upstream_id":"2557","short_description":"What do the results of studies with twins suggest about the influence of…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Heredity dictates personality completely, and the environment has no impact.', 'Identical twins raised apart will have completely different personalities due to environmental differences.', 'Personality traits are inherited in a fixed pattern, similar to physical traits like eye color.', 'Heredity determines intelligence, which in turn completely determines personality.', 'Heredity has no influence on personality.', 'Personalities are influenced only by peer interactions, not by heredity or family environment.', 'Fraternal twins have more similar personalities than identical twins due to shared environments.', 'Heredity provides a capacity for a wide range of behavior that may then be encouraged or sustained by the environment.', 'Environment solely determines personality traits.', 'Identical twins always have identical personalities.']\",\"question\":\"What do the results of studies with twins suggest about the influence of heredity on personality?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}