{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5c825406-0792-5205-b40d-6c8c6230f2e4","task_key":"default--test--3098","task_revision_id":"1","upstream_id":"3098","short_description":"In certain abnormal conditions, the stomach does not secretehydrochloric acid.…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The absence of HCl would cause the stomach lining to produce more acid.', 'The absence of HCl would lead to the complete digestion of lipids in the stomach.', 'The absence of HCl would lead to some loss of protein digestion, less denaturation of proteins, less killing of ingested bacteria, and less pancreatic secretion.', 'The absence of HCl would increase the level of gastric enzymes.', 'The absence of HCl would lead to improved digestion of carbohydrates.', 'The absence of HCl would stimulate the liver to release more bile.', 'The absence of HCl would have no effect on the digestive process.', 'The absence of HCl would enhance the activity of gastric lipase.', 'The absence of HCl would result in more efficient absorption of nutrients.', 'The absence of HCl would increase the secretion of pancreatic juice.']\",\"question\":\"In certain abnormal conditions, the stomach does not secretehydrochloric acid. What effects might this haveon thedigestive process?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}