{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"89271ec5-714b-5c7d-a082-06f6dd183d4b","task_key":"all--test--89271ec5-714b-5c7d-a082-06f6dd183d4b","task_revision_id":"1","upstream_id":"","short_description":"On an average daily basis, the gross energy intake of a healthy woman is 9279…","config":"all","split":"test","body":"{\"choices\":\"['647 kJ and 318 kJ', '9279-318 kJ and 9279-647 kJ', '9279+318 kJ and 9279+647 kJ', '9279-647 kJ and 9279-(647+318) kJ']\",\"question\":\"On an average daily basis, the gross energy intake of a healthy woman is 9279 kJ, the energy content of her faeces and urine are 647 kJ and 318 kJ, respectively. Her average daily digestible energy intake and metabolisable energy intake would be, respectively,:\\n\",\"subject\":\"nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}