{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0bbc7dce-3446-55e0-b1f6-123d96707793","task_key":"all--test--0bbc7dce-3446-55e0-b1f6-123d96707793","task_revision_id":"1","upstream_id":"","short_description":"Which of these best describes the concept of hegemonic masculinity?","config":"all","split":"test","body":"{\"choices\":\"['The inherent promotion of feminine characteristics in society.', \\\"Social dominance of men over women that results from the designation of 'masculine' characteristics as more valued than 'feminine' characteristics.\\\", 'All of these options.', 'The acknowledgement that gender identity exists in many forms and is not binary.']\",\"question\":\"Which of these best describes the concept of hegemonic masculinity?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}