{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f2c572be-a9e1-57aa-a49b-77a4d12ec90e","task_key":"default--test--2314","task_revision_id":"1","upstream_id":"2314","short_description":"How can evaluation apprehension be eliminated fromsocial…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"[\\\"By conducting the experiment with subject's peers present\\\", 'By offering financial incentives to the subjects', 'By making the subject aware they are being observed', \\\"Through field experimentation and 'nonobtrusive' approaches\\\", 'By providing subjects with false feedback on their performance', 'By increasing the number of observers in the experiment', 'By using a double-blind procedure where neither the subjects nor the experimenters know the true purpose of the study', 'By conducting the experiment in a familiar environment']\",\"question\":\"How can evaluation apprehension be eliminated fromsocial psychologicalexperimental settings?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}