{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"aab284d8-1c33-5305-a47d-bbf6cf718563","task_key":"all--test--aab284d8-1c33-5305-a47d-bbf6cf718563","task_revision_id":"1","upstream_id":"","short_description":"In personnel selection, it is appropriate to ask a person's age when","config":"all","split":"test","body":"{\"choices\":\"['employees in a given age group may not perform as well as some younger employees in the same job', 'age is a bona fide occupational requirement', 'properly administered intelligence and personality tests suggest that the incumbent is not likely to perform satisfactorily in the future', 'standardized test results show thar the incumbent does not have all the aptitudes expected for the particular job']\",\"question\":\"In personnel selection, it is appropriate to ask a person's age when\",\"subject\":\"professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}