{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"92e74507-4f5e-5a7d-932f-028631b9312d","task_key":"default--test--2212","task_revision_id":"1","upstream_id":"2212","short_description":"Which of the following statements is most closely related to the projective…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Social functioning is a reflection of psychological functioning', 'Psychological functioning is a reflection of social functioning', 'Social functioning is independent of psychological functioning', 'The use of the defense mechanism of denial is symptomatic of impulses “projected” onto the environment', 'Psychological functioning is independent of the interpretation of ambiguous situations', \\\"Ambiguous situations reveal nothing about an individual's psychological functioning\\\", 'The way an individual reacts to explicit situations will reflect inner aspects of psychological functioning', 'The way an individual interprets ambiguous situations will reflect inner aspects of psychological functioning', 'The use of the defense mechanism of projection is symptomatic of impulses “internalized” within the individual', 'The use of the defense mechanism of projection is symptomatic of impulses “projected” onto the environment']\",\"question\":\"Which of the following statements is most closely related to the projective hypothesis\",\"src\":\"ori_mmlu-professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}