{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4066467c-6363-5522-8e32-34852410d1d0","task_key":"default--test--2299","task_revision_id":"1","upstream_id":"2299","short_description":"What distinctions are made when defining aggression in psychology?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Harmful versus non-harmful aggression, the intent of the aggressor, and aggression as a means to an end versus aggression as an end in itself', 'Instrumental aggression, spontaneous aggression, and territorial aggression', 'Intentional aggression, accidental aggression, and unprovoked aggression', 'Physical aggression, psychological aggression, and accidental aggression', 'Inwardly directed aggression, outwardly directed aggression, and aggression stemming from fear']\",\"question\":\"What distinctions are made when defining aggression in psychology?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}