{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d0171505-cbb0-5676-85ed-e1c0dcc6766e","task_key":"all--test--d0171505-cbb0-5676-85ed-e1c0dcc6766e","task_revision_id":"1","upstream_id":"","short_description":"In response to Sandel's argument about the relationship between genetic…","config":"all","split":"test","body":"{\"choices\":\"['genetic transformation will actually strengthen the bond between parent and child.', 'children are too young to understand the implications of genetic enhancement.', \\\"Sandel's reasoning does not rule out the use of moderate, worthwhile genetic transformation.\\\", 'the use of training and appliances as a way of transforming gifts is not, as Sandel argues, morally permissible.']\",\"question\":\" In response to Sandel's argument about the relationship between genetic enhancement and parent-child relationships, Kamm argues that\",\"subject\":\"moral_disputes\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}