{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a083dc1d-3272-52ff-b0f5-9bc1597fe539","task_key":"default--test--6815","task_revision_id":"1","upstream_id":"6815","short_description":"Which of the following statements about glucose metabolism is correct?","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['The end-product of glycolysis in all cells is glucose', \\\"Glycolysis doesn't require any enzymes\\\", 'In glycolysis, glucose is cleaved into two three-carbon products', 'Glucose metabolism only occurs in the presence of oxygen', 'In glycolysis, glucose is converted into two molecules of fructose', 'Glycolysis requires ATP only', 'Glucagon increases the rate of glycolysis', 'Glycolysis requires NADP+', 'Glucagon decreases the rate of glycolysis', 'The end-product of glycolysis in red blood cells is pyruvate']\",\"question\":\"Which of the following statements about glucose metabolism is correct?\\n\",\"src\":\"ori_mmlu-nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}