{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7dc11dd7-90fe-5d3c-8528-6682fcc61c74","task_key":"default--test--2678","task_revision_id":"1","upstream_id":"2678","short_description":"Discuss transfer of training in everyday life and in formal education.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Direct transfer, indirect transfer, and transfer of principles', 'Transfer of training, transfer of elements, and transfer of theory', 'Horizontal transfer, vertical transfer, and random transfer', 'Cognitive transfer, affective transfer, and psychomotor transfer', 'Immediate transfer, delayed transfer, and ultimate transfer', 'Positive transfer, negative transfer, and zero transfer', 'General transfer, specific transfer, and non-transferable skills', 'Negative transfer, positive transfer, and maximum transfer', 'Proactive transfer, retroactive transfer, and situational transfer', 'Transfer of elements, formal-discipline theory, and mental-faculty theory']\",\"question\":\"Discuss transfer of training in everyday life and in formal education.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}