{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6366c10c-bf3e-50cf-b264-3b76caae2e65","task_key":"all--test--6366c10c-bf3e-50cf-b264-3b76caae2e65","task_revision_id":"1","upstream_id":"","short_description":"After Tamika complained to her mother about how little she has, Tamika and her…","config":"all","split":"test","body":"{\"choices\":\"['relative deprivation', 'adaptation-level', 'Yerkes-Dodson arousal', 'diathesis-stress']\",\"question\":\"After Tamika complained to her mother about how little she has, Tamika and her mother went to a soup kitchen to volunteer to serve dinner to the homeless. After serving 120 dinners, Tamika told her mother how happy she is that they can afford to buy delicious foods she loves. Tamika's increased perception that she is happy is best explained by applying which of the following theories?\",\"subject\":\"high_school_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}