{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6b400395-e6ad-5a2f-a667-06ad2ceb0bc2","task_key":"all--test--6b400395-e6ad-5a2f-a667-06ad2ceb0bc2","task_revision_id":"1","upstream_id":"","short_description":"To characterize a binge eating episode one must investigate the presence of:","config":"all","split":"test","body":"{\"choices\":\"['If patients feel that their eating habits are chaotic, regardless of meal size.', 'The consumption of large quantities of sweets between meals.', 'A subjective component of lack of control and an objective component of large consumption of food in a discrete period of time', 'The feeling that one cannot choose the type of food eaten even if their quantity is kept under control.']\",\"question\":\"To characterize a binge eating episode one must investigate the presence of:\\n\",\"subject\":\"nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}