{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5b13d2d3-09aa-5eb4-b7dc-e7818e10730f","task_key":"all--test--5b13d2d3-09aa-5eb4-b7dc-e7818e10730f","task_revision_id":"1","upstream_id":"","short_description":"In the Harlow study of emotional attachment, infant monkeys were placed in a…","config":"all","split":"test","body":"{\"choices\":\"['with which \\\"mother\\\" the bottle of milk is placed', 'the \\\"wire\\\" mother versus the \\\"cloth\\\" mother', 'the preference of the infants for the source of milk', 'the preference of the infants for the \\\"wire\\\" mother']\",\"question\":\"In the Harlow study of emotional attachment, infant monkeys were placed in a cage and given both a \\\"wire\\\" mother and a \\\"cloth\\\" mother. Researchers then moved a bottle of milk from one mother to the other while introducing various stimuli to see if the monkeys would form an attachment to either of the \\\"mothers.\\\" In this experiment, the independent variable is\",\"subject\":\"high_school_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}