{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"39fdbbe4-a2a5-54a6-82b1-14c1982f1cbd","task_key":"default--test--2964","task_revision_id":"1","upstream_id":"2964","short_description":"Theglomerularfiltration rate is controlled primarily by alteration of…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Glomerular capillary pressure and blood volume', 'Diameter of the efferent arterioles and plasma protein concentration', 'Renal blood flow and the concentration of sodium in the distal tubule', 'Arterial blood pressure and diameter of the afferent arterioles', 'Kidney size and blood urea nitrogen levels', 'Interstitial fluid pressure and the concentration of glucose in the blood', 'Hormonal regulation by antidiuretic hormone (ADH) and aldosterone levels', 'Sympathetic nervous system activity and atrial natriuretic peptide (ANP)', 'Concentration of electrolytes in the blood and the rate of tubular secretion', 'Blood viscosity and heart rate']\",\"question\":\"Theglomerularfiltration rate is controlled primarily by alteration of theglomerularcapillary pressure. What are the two factors which produce these changes?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}