{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b667e06e-f93c-5052-8af1-60055ced8594","task_key":"default--test--6573","task_revision_id":"1","upstream_id":"6573","short_description":"Which of the following best explains the antioxidant action of vitamin E?","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['It is lipid soluble and can react with free radicals in the bloodstream resulting from nitric oxide formation by vascular epithelium', 'It forms an unstable radical that can be reduced back to active vitamin E by reaction with vitamin C', 'It is lipid soluble and can react with free radicals in the bloodstream resulting from carbon dioxide formation by vascular epithelium', 'It is converted to an unstable radical by reaction with vitamin C', 'It is water soluble and can react with free radicals in the bloodstream resulting from nitric oxide formation by vascular epithelium', 'It forms a stable radical that can be reduced back to active vitamin E by reaction with vitamin B12.', 'It forms a stable radical that can be reduced back to active vitamin E by reaction with vitamin C', 'It forms a stable radical that cannot be reduced back to active vitamin E by reaction with glutathione and glutathione peroxidase', 'It is converted to a stable radical by reaction with vitamin C']\",\"question\":\"Which of the following best explains the antioxidant action of vitamin E?\\n\",\"src\":\"ori_mmlu-nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}