{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"685abdbf-9c99-567b-9b16-ed53a869f29f","task_key":"default--test--2370","task_revision_id":"1","upstream_id":"2370","short_description":"How is culture a source of social influence?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Culture is a source of social influence because it dictates individual preferences.', \\\"Culture is a source of social influence as it determines one's genetic makeup.\\\", 'Culture is a source of social influence because it is the primary factor in determining individual physical health and wellbeing.', 'Culture is a source of social influence because it shapes the language one speaks and thus controls all forms of communication.', 'Culture is a source of social influence because it controls the economic status of individuals.', \\\"Culture is a source of social influence as it solely determines one's career path and professional success.\\\", 'Culture is a source of social influence as it provides people with a number of ready-made answers for crucial life problems, dictates routine relationships and social arrangements, and gives an entire group of people a means of coping with the world.', 'Culture is a source of social influence because it directly alters the physical environment people live in.', 'Culture is a source of social influence because it mandates the political structure of society.', 'Culture is a source of social influence as it is inherited biologically from parents to children.']\",\"question\":\"How is culture a source of social influence?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}