{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a4abf53a-e7dc-5494-9008-c0ae2925b012","task_key":"default--test--6668","task_revision_id":"1","upstream_id":"6668","short_description":"A healthy 22-year-old man participates in a study of glucose metabolism. At the…","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Increased glucose uptake by the brain', 'Continued gut absorption of calories from the ingested meal', 'Increased glucose uptake by red blood cells', 'Glucose release from skeletal muscle', 'Glycogenolysis in the liver', 'Increased leptin release from adipose tissues', 'Enhanced gluconeogenesis in the kidney', 'Elevated insulin secretion from the pancreas']\",\"question\":\"A healthy 22-year-old man participates in a study of glucose metabolism. At the beginning of the study, his serum glucose concentration is within the reference range. He consumes an 800-calorie meal consisting of protein, fat, and carbohydrates. He then sleeps through the night without additional food or drink. Twelve hours later, his serum glucose concentration remains within the reference range. Which of the following mechanisms is most likely involved in maintaining this man's serum glucose concentration?\",\"src\":\"ori_mmlu-professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}