{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a8a8e0bb-cb98-597a-a3e5-69acf82b9857","task_key":"default--test--2565","task_revision_id":"1","upstream_id":"2565","short_description":"Which of the following is true of low-context communication?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['It focuses more on the speaker than the listener', 'It relies heavily on the use of metaphors', 'It is grounded in the situation', 'It relies heavily on nonverbal cues', 'It is less effective in conveying emotions', 'It is a less unifying form of communication', 'It is more typical of culturally homogenous groups in the United States', 'It is more common in high-context cultures', 'It is mainly used in formal settings']\",\"question\":\"Which of the following is true of low-context communication?\",\"src\":\"ori_mmlu-professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}