{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f71e8062-4833-540b-8f0f-81935932a68b","task_key":"default--test--6631","task_revision_id":"1","upstream_id":"6631","short_description":"Which statement about intestinal \"brakes\" and \"accelerators\" is FALSE?","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Short-chain fatty acids which move from colon to caecum (reflux) promote ileo-caecal motility', 'The arrival of fiber in the colon causes an increase in motility and a switch from the \\\"fasting\\\" to the \\\"feeding\\\" pattern.', 'The arrival of lipid in the duodenum causes an immediate reduction in motility and a switch from the \\\"fasting\\\" to the \\\"feeding\\\" pattern.', 'Food in the stomach causes gastrin release, which stimulates acid secretion', 'Protein ingestion leads to immediate increase in intestinal motility', 'Gastric acid secretion inhibits small intestinal motility', 'The presence of bile in the intestine slows down motility', 'The presence of undigested food in the colon stimulates intestinal motility', 'Dietary starch is a potent stimulator of small intestinal motility because it causes insulin release from the pancreas', 'The presence of glucose in the duodenum accelerates intestinal motility']\",\"question\":\"Which statement about intestinal \\\"brakes\\\" and \\\"accelerators\\\" is FALSE?\\n\",\"src\":\"ori_mmlu-nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}