{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a5c69faf-f7bd-5d19-9330-433a77eea709","task_key":"default--test--2303","task_revision_id":"1","upstream_id":"2303","short_description":"Most suicides do not want to die. Discuss. What are the measurestaken by suicide…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Tell them to stay busy to distract themselves from their thoughts', 'Discourage them from talking about their thoughts or feelings to anyone', 'Encourage the use of alcohol or drugs to cope with their feelings', \\\"Avoid discussing the person's problems\\\", 'Suggest that their feelings are not that serious and will pass in time', 'Focus only on long-term planning without addressing immediate concerns', 'Ignore the subtle cries for help', 'Provide false reassurances and downplay their feelings', 'Determine the risk, establish a relationship, identify and clarify problems, suggest possible solutions', 'Encourage the person to be alone']\",\"question\":\"Most suicides do not want to die. Discuss. What are the measurestaken by suicide prevention counselors?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}