{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f31aa42b-0318-5a9a-ac3a-2dd5d5a23b42","task_key":"default--test--2745","task_revision_id":"1","upstream_id":"2745","short_description":"Define culture. What does Benedict (1934) mean by cultural relativity?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Cultural relativity is the practice of comparing different cultural practices without bias.', \\\"Cultural relativity is the idea that one's own culture is superior to others.\\\", 'Cultural relativity is the economic system through which cultural goods are produced and distributed.', 'Cultural relativity is a theory that suggests culture is inherited genetically.', 'Cultural relativity is the study of cultural differences.', 'Cultural relativity is the belief that human behavior can only be understood and evaluated within the context of its cultural environment.', 'Cultural relativity is the adaptation of culture to its environment.', 'Cultural relativity is the scientific study of how culture is transmitted through language and symbols.', 'Cultural relativity is the belief that all cultures are equal.', 'Cultural relativity is the process by which a culture adopts and assimilates foreign cultural elements.']\",\"question\":\"Define culture. What does Benedict (1934) mean by cultural relativity?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}