{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"81f4b3c8-ccd5-58fe-a2ea-8f5e75cd8983","task_key":"all--test--81f4b3c8-ccd5-58fe-a2ea-8f5e75cd8983","task_revision_id":"1","upstream_id":"","short_description":"During the mammalian cardiac cycle, a volume of blood equivalent to ventricular…","config":"all","split":"test","body":"{\"choices\":\"['no change in pressure in either compartment', 'no effect on venous pressure and a small increase in arterial pressure', 'an increase in venous pressure and an equal but opposite decrease in arterial pressure', 'little effect on venous pressure and a large increase in arterial pressure']\",\"question\":\"During the mammalian cardiac cycle, a volume of blood equivalent to ventricular stroke volume is transferred from the more compliant venous side to the less compliant arterial side of the circulation. In terms of pressures within the venous and arterial compartments, this transfer results in\",\"subject\":\"college_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}