{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ffba6af4-3d17-5729-9cc7-a587ced51dec","task_key":"default--test--2273","task_revision_id":"1","upstream_id":"2273","short_description":"In terms of age, Erikson’s ________ stage of psychosocial development…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['identity vs. role confusion', 'autonomy vs. shame and doubt', 'ego integrity vs. despair', 'intimacy vs. isolation', 'industry vs. inferiority', 'industry vs. guilt', 'initiative vs. guilt.', 'basic trust vs. mistrust', 'autonomy vs. mistrust', 'generativity vs. stagnation']\",\"question\":\"In terms of age, Erikson’s ________ stage of psychosocial development corresponds to Freud’s phallic stage.\",\"src\":\"ori_mmlu-professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}