{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4f9e59b8-710f-5bbf-8d87-f0c5006e542b","task_key":"default--test--2416","task_revision_id":"1","upstream_id":"2416","short_description":"How do men and women differ in their scores on the need for achievement? Why…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Men and women have the same focus in their need to achieve', \\\"Women's need for achievement is higher in younger ages but equalizes with men as they enter the workforce.\\\", 'Men score higher than women in need for achievement due to biological differences that are innate and unchanging over time.', 'As men and women grow older, their need for achievement decreases', 'Both men and women show an increase in the need for achievement after retirement due to having more free time to pursue personal goals.', \\\"Men's need for achievement is more influenced by peer pressure and societal expectations, while women's need is more self-motivated.\\\", \\\"Men's need for achievement is directed more towards competitive sports and physical challenges, while women's need is directed towards academic and professional success.\\\", 'The need for achievement is entirely culturally constructed, with no real differences between men and women, but perceived differences arise from measurement bias.', 'Women score higher than men in need for achievement', \\\"Women's need to achieve is directed differently than that of men, focusing more on homemaking or social success due to societal programming. The difference in scores increases as they grow older, with men's need for achievement increasing and women's decreasing.\\\"]\",\"question\":\"How do men and women differ in their scores on the need for achievement? Why might this be?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}