{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5d3e4ab8-0ee1-52c3-b1db-5d2269397302","task_key":"all--test--5d3e4ab8-0ee1-52c3-b1db-5d2269397302","task_revision_id":"1","upstream_id":"","short_description":"A 55-year-old man has had crushing substernal chest pain on exertion over the…","config":"all","split":"test","body":"{\"choices\":\"['Decreasing myocardial contractility', 'Dilating the coronary arteries', 'Peripheral vasodilation', 'Preventing fibrin and platelet plugs']\",\"question\":\"A 55-year-old man has had crushing substernal chest pain on exertion over the past 6 weeks. He had a myocardial infarction 2 months ago. He takes nitroglycerin as needed and one aspirin daily. He has smoked two packs of cigarettes daily for 30 years. Examination shows normal heart sounds and no carotid or femoral bruits. Treatment with a β-adrenergic blocking agent is most likely to improve his symptoms due to which of the following mechanisms?\",\"subject\":\"professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}