{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b5561d89-043b-535e-80a8-41815b80b3e3","task_key":"all--test--b5561d89-043b-535e-80a8-41815b80b3e3","task_revision_id":"1","upstream_id":"","short_description":"Which of the following statements best describes a researcher’s obligations…","config":"all","split":"test","body":"{\"choices\":\"['Animals should never be used in research when alternative procedures are available.', 'Animals should never be used in research if a research procedure will cause them pain or stress.', 'Inflicting pain or stress on animals is acceptable in research only when an alternative (nonpainful) procedure is unavailable and the use of the procedure is justified by the potential value of the study.', 'Inflicting pain or stress on animals is acceptable in research as long as it is minimized and the animal’s life is terminated as soon as is feasible.']\",\"question\":\"Which of the following statements best describes a researcher’s obligations regarding the use of animals in psychological research?\",\"subject\":\"professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}