{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8f021db9-7929-57d1-9c3c-784467fcc6a7","task_key":"default--test--6637","task_revision_id":"1","upstream_id":"6637","short_description":"The amount and composition of dietary fat are important factors for influencing…","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Replacement of saturated fatty acids with n-3 polyunsaturated fatty acids is associated with an increase in plasma triglyceride concentrations', 'Replacement of saturated fatty acids with monounsaturated fatty acids is associated with a decrease in HDL cholesterol', 'Replacement of saturated fatty acids with large amounts of carbohydrate is associated with decreased LDL and increased plasma triglyceride concentrations', 'Replacement of saturated fatty acids with monounsaturated fatty acids is associated with an increase in LDL cholesterol', 'Consumption of soluble dietary fibre and plant stanols/sterols is associated with a significant increases in LDL cholesterol']\",\"question\":\"The amount and composition of dietary fat are important factors for influencing blood lipid metabolism. Which of the following statements is correct?\\n\",\"src\":\"ori_mmlu-nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}