{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"33de8b0c-b0d2-5440-a0f1-8c58e65f53f5","task_key":"default--test--3165","task_revision_id":"1","upstream_id":"3165","short_description":"During the mammalian cardiac cycle, a volume of blood equivalent to ventricular…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['an equal increase in both venous and arterial pressure', 'little effect on venous pressure and a large increase in arterial pressure', 'an increase in venous pressure and an equal but opposite decrease in arterial pressure', 'a small decrease in venous pressure and a large increase in arterial pressure', 'a large increase in venous pressure and a small increase in arterial pressure', 'a decrease in venous pressure and no change in arterial pressure', 'an increase in both venous and arterial pressure', 'no change in pressure in either compartment', 'no effect on venous pressure and a small increase in arterial pressure', 'a decrease in both venous and arterial pressure']\",\"question\":\"During the mammalian cardiac cycle, a volume of blood equivalent to ventricular stroke volume is transferred from the more compliant venous side to the less compliant arterial side of the circulation. In terms of pressures within the venous and arterial compartments, this transfer results in\",\"src\":\"ori_mmlu-college_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}