{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"95491a27-49a2-56db-a50a-11b49ed32a23","task_key":"default--test--2127","task_revision_id":"1","upstream_id":"2127","short_description":"Discuss Mead's (1935) study of three New Guinea tribes. What do her findings…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Culture has no effect on personality traits.', 'Personality traits, especially those related to dominance, vary depending on the culture.', 'The differences in personality traits among the tribes were insignificant.', 'Only one of the tribes showed variation in personality traits due to cultural influences.', 'Personality traits are universally consistent due to shared human experience.', 'The study concluded that environment has a stronger effect on personality than culture does.', 'Personality traits are determined by genetics.', 'The study indicated that cultural norms have no distinct patterns or effects on the personality traits of the tribes.', 'Personality traits are the same across all cultures.', \\\"Mead's findings suggest that personality traits are primarily influenced by biological factors, with little cultural impact.\\\"]\",\"question\":\"Discuss Mead's (1935) study of three New Guinea tribes. What do her findings indicate about the effect of culture on personality?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}