{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"09755ad7-5dc6-579b-bf7e-b072a1e23883","task_key":"default--test--2453","task_revision_id":"1","upstream_id":"2453","short_description":"Studies into the etiology of Schizophrenia indicated a genetic predisposition to…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Excess dopamine or sensitivity to dopamine could be a contributory factor.', 'A lower rate of Schizophrenia diagnosed among Africa Americans.', 'Schizophrenia is primarily caused by poor lifestyle choices', 'Schizophrenia can be completely cured through psychotherapy', 'All schizophrenia patients exhibit severe personality splitting']\",\"question\":\"Studies into the etiology of Schizophrenia indicated a genetic predisposition to the condition but other factors are involved. From your knowledge of the subject identify which of the following statements is incorrect.\",\"src\":\"ori_mmlu-professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}