{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ccdcbc8c-e0b9-5afd-b1aa-9663bf7528c6","task_key":"all--test--ccdcbc8c-e0b9-5afd-b1aa-9663bf7528c6","task_revision_id":"1","upstream_id":"","short_description":"How does the preoccupation with human rights affect the human rights orientated…","config":"all","split":"test","body":"{\"choices\":\"['Modern human rights oriented liberalism is concerned with self-determination.', 'Human rights orientated liberalism will advocate separatism where conflict and bloodshed seem inevitable without it.', 'Human rights orientated liberalism is particularly focused on persons subject to economic, sexual, gender, religious, and political persecution, discrimination, or deprivation.', 'All of these options.']\",\"question\":\"How does the preoccupation with human rights affect the human rights orientated school of liberalism?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}