{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"88dd9a84-15bf-5b96-9074-6f6565bac44f","task_key":"default--test--2255","task_revision_id":"1","upstream_id":"2255","short_description":"What are the selection procedures you would use to select a manager ?Discuss…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Marital status, Place of birth, Favorite color', 'Personality test results, Social media presence, Volunteer work history', 'Social maturity and breadth, Intelligence, Motivation and drive for achievement, Human relations development, Leadership style', 'Height and weight, Zodiac sign, Shoe size']\",\"question\":\"What are the selection procedures you would use to select a manager ?Discuss your answer.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}