{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e1b72be8-af44-55ca-84eb-f1bd536c3b5c","task_key":"default--test--2035","task_revision_id":"1","upstream_id":"2035","short_description":"Discuss the psychological impact of physical deviation in adolescents.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Physical deviation has no impact on adolescents', 'Physical deviation leads to superior athletic performance in adolescents', 'Physical deviation causes a heightened sense of physical well-being in adolescents', 'Physical deviation diminishes the importance of peer relationships in adolescents', 'Physical deviation causes excitement in adolescents', 'Physical deviation can cause stress and anxiety in adolescents', 'Physical deviation enhances social acceptance in adolescents', 'Physical deviation increases academic performance in adolescents', 'Physical deviation is always associated with increased creativity in adolescents', 'Physical deviation results in immediate popularity among peers']\",\"question\":\"Discuss the psychological impact of physical deviation in adolescents.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}