{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f8342965-86aa-5124-a3c4-1e2699c17d48","task_key":"default--test--2149","task_revision_id":"1","upstream_id":"2149","short_description":"Berkowitz (1971) revised the original frustration-aggression hypothesis by…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['the target of the aggression is of lower-status than the aggressor.', 'the aggressor is experiencing high levels of stress.', 'there are aggressive cues in the environment.', 'acting aggressively is likely to produce desirable outcomes.', 'the target of the aggression has shown previous signs of weakness.', 'the aggressor feels threatened or endangered.', 'the aggression can be blamed on external factors.', 'the aggressor has been previously rewarded for aggressive behavior.', 'there is a lack of social support for the aggressor.', 'the aggressor has an internal locus of control.']\",\"question\":\"Berkowitz (1971) revised the original frustration-aggression hypothesis by proposing that frustration leads to aggression when:\",\"src\":\"ori_mmlu-professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}