{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cdbdfaff-95aa-5b38-9b5c-747423876729","task_key":"default--test--6821","task_revision_id":"1","upstream_id":"6821","short_description":"The effects of iron on certain aspects of socio-emotional development (shyness,…","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['The role of iron in serotonin production', 'None of the above', 'The role of iron in neurochemistry', 'The role of iron in maintaining blood sugar levels', 'The role of iron in muscle function', 'The role of iron in energy metabolism', 'The role of iron in dopamine production', 'The role of iron in myelination', 'The role of iron in cognitive development', 'The role of iron in red blood cell production']\",\"question\":\"The effects of iron on certain aspects of socio-emotional development (shyness, orientation/engagement and response to unfamiliar pictures) is due to:\\n\",\"src\":\"ori_mmlu-nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}