{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bb526403-046a-52ad-a287-ab6929c673f0","task_key":"default--test--6059","task_revision_id":"1","upstream_id":"6059","short_description":"Water transport can occur from the lumen of the intestine to the blood stream,…","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Dietary intake of water is always greater than water movement in the small intestine', 'Water flows into the gut from the mucosa, during digestion of starch and protein, in order to reduce luminal osmolality', 'Water flows out of the gut from the mucosa, during digestion of starch and protein, in order to increase luminal osmolality', 'Water is primarily transported by movement within the cells lining the gut (enterocytes)', 'Water is mostly absorbed by movement between the cells lining the gut (enterocytes) via tight junctions', 'Water transport from the blood stream to the intestinal lumen only occurs during digestion', 'Water transport from the intestine to the blood stream does not occur during digestion', 'A \\\"flip-flop\\\" mechanism efficiently transports water directly across the enterocyte membrane', 'Water is mostly absorbed by the cells lining the gut (enterocytes) via osmosis', 'Water movement in the small intestine is always lesser than dietary intake of water']\",\"question\":\"Water transport can occur from the lumen of the intestine to the blood stream, or from the blood stream to the intestinal lumen. Which single statement about this phenomenon, below, is actually correct?\\n\",\"src\":\"ori_mmlu-nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}