{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b7df0b3f-1795-5a15-8381-933da2a59aa5","task_key":"all--test--b7df0b3f-1795-5a15-8381-933da2a59aa5","task_revision_id":"1","upstream_id":"","short_description":"Why is it important that personal data about research participants are kept…","config":"all","split":"test","body":"{\"choices\":\"['So that the participants cannot find out what has been written about them.', 'In case individuals, places, or organizations can be harmed through identification or disclosure of personal information.', 'So that government officials, teachers, and other people in authority can have easy access to the data.', 'To enable the researcher to track down individuals and find out more about their lives.']\",\"question\":\"Why is it important that personal data about research participants are kept within secure, confidential records?\",\"subject\":\"philosophy\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}