{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c74eed53-9c54-5532-9529-599b7e6a4f34","task_key":"all--test--c74eed53-9c54-5532-9529-599b7e6a4f34","task_revision_id":"1","upstream_id":"","short_description":"Which of these statements concerning the study of identity is not applicable to…","config":"all","split":"test","body":"{\"choices\":\"['Identity defines actors, and tells us who they are, what their preferences and interests are, and how those preferences might inform their actions.', 'Identity is of fundamental importance to the social constructivist perspective because it is the basest principle in defining behaviour; it is a naturally bestowed quality comprised of certain unalterable behavioural characteristics.', 'The identities, interests and behaviour of political agents are socially constructed by shared ideas, collective meaning, and interpretations and assumptions about the world.', 'Actors form their identity through interaction, which in turn defines the types of relationship formed between these actors.']\",\"question\":\"Which of these statements concerning the study of identity is not applicable to social constructivism?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}