{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"80e63e97-6e09-5c3e-998b-992983560d8e","task_key":"default--test--6708","task_revision_id":"1","upstream_id":"6708","short_description":"The pancreas secretes a large amount of digestive enzymes after a meal. Which…","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Bile is needed to activate all pancreatic enzymes', 'All pancreatic enzymes are produced in an active form and can start digestion immediately', 'Enzymes are produced in the pancreas but released in the stomach for digestion', 'Pepsinogen is the chief enzyme which digests protein and requires removal of a peptide sequence from the active cleft before it can work', 'Pancreatic secretion of hydrochloric acid is required to provide the correct pH for maximal pancreatic enzyme in the duodenum', 'Enteropeptidase converts trypsinogen to trypsin by cleavage of a peptide sequence that blocks the active site of trypsin.', 'Pancreatic enzymes are needed to break down carbohydrates only.', 'Pancreatic á-amylase will hydrolyse starch to free glucose']\",\"question\":\"The pancreas secretes a large amount of digestive enzymes after a meal. Which statement about this process is correct?\\n\",\"src\":\"ori_mmlu-nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}