{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9778d604-607e-5fe8-913f-8ee9701d998a","task_key":"default--test--2200","task_revision_id":"1","upstream_id":"2200","short_description":"Lewinsohn’s behavioral model proposes a causal link between ______________ and…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['high levels of self-esteem', 'a lack of reinforcement from the environment', 'lack of familial support', 'constant exposure to positive reinforcement', 'overly supportive environments', 'a high need for perfectionism', '“accidental” external reinforcement for depressogenic behaviors', 'constant exposure to stressful events', 'chronic physical and psychological stress', 'high levels of physical activity']\",\"question\":\"Lewinsohn’s behavioral model proposes a causal link between ______________ and depression.\",\"src\":\"ori_mmlu-professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}