{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"131bdc60-f2a1-526d-b469-52cdc813a1a3","task_key":"all--test--131bdc60-f2a1-526d-b469-52cdc813a1a3","task_revision_id":"1","upstream_id":"","short_description":"An employee of large manufacturing firm finds the work dull, and pursues the job…","config":"all","split":"test","body":"{\"choices\":\"['offer a raise and incentive pay for greater productivity', 'redesign the job to provide a challenge and a sense of accomplishment', 'increase opportunities for informed social interaction', 'provide the employee with a job tide carrying greater prestige']\",\"question\":\"An employee of large manufacturing firm finds the work dull, and pursues the job only for the money. The employee performs minimally, and is not motivated so produce highest quantity or better quality. According to F. Herzberg's two-factor theory, the best way 10 increase this worker's self-motivation would be to\",\"subject\":\"professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}