{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"857f6576-027f-53aa-a6d0-926da588dae3","task_key":"all--test--857f6576-027f-53aa-a6d0-926da588dae3","task_revision_id":"1","upstream_id":"","short_description":"The hypothalamus controls the stress response of the body by releasing CRF,…","config":"all","split":"test","body":"{\"choices\":\"['Constriction of blood flow to the adrenal gland.', 'Exhaustion of the body’s store of CRF.', 'Negative feedback loop of cortisol.', 'Release of CRF-inhibitory factor.']\",\"question\":\"The hypothalamus controls the stress response of the body by releasing CRF, which leads to eventual release of cortisol, the body’s stress hormone, systemically. This trigger is eventually suppressed by which mechanism?\",\"subject\":\"college_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}