{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6a0da756-0c18-5ec7-bda9-d43ed1305750","task_key":"default--test--2194","task_revision_id":"1","upstream_id":"2194","short_description":"What sex and race differences have been found on the Internal-External Control…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Women are more internal than men, but there is no significant difference between blacks and whites', 'There are no sex and race differences on the Internal-External Control Scale', 'Women are more external than men and blacks are more external than whites', 'Women are more internal than men and blacks are more internal than whites', 'There is no significant difference between men and women, but blacks are more external than whites', 'Women are more internal than men, and whites are more internal than blacks', 'Women and men are equally internal, but whites are more internal than blacks', 'Men are more external than women and whites are more external than blacks', 'Men are more internal than women and blacks are more internal than whites', 'Men and women are equally external, but blacks are more internal than whites']\",\"question\":\"What sex and race differences have been found on the Internal-External Control Scale? Discuss.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}