{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a08912fd-54e4-53fc-a62f-84e536781432","task_key":"all--test--a08912fd-54e4-53fc-a62f-84e536781432","task_revision_id":"1","upstream_id":"","short_description":"According to trait theorists, such as Hans Eysenck, the basis for personality is","config":"all","split":"test","body":"{\"choices\":\"['conflicting sources of psychic energy', 'the distinctive human ability to act purposefully and to shape our own destiny', 'the interactions between thought and the environment, which influence behavior', 'stable sources of individual differences that characterize an individual, based on an interaction of nature and nurture']\",\"question\":\"According to trait theorists, such as Hans Eysenck, the basis for personality is\",\"subject\":\"high_school_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}