{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1733025d-5965-58c8-a7d6-bd4e5f900f01","task_key":"default--test--6700","task_revision_id":"1","upstream_id":"6700","short_description":"It is correct to state that for the treatment of Bulimia Nervosa:","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Treatment should focus solely on physical symptoms', 'Treatments should target exclusively on purging practices', 'It is not useful to discuss weight with patients', 'Therapies should primarily focus on food avoidance tactics', 'The first approach is to discuss body image', 'Use of antipsychotic medication is first-line treatment', \\\"Treatment should prioritize on patients' social relationships\\\", 'Treatment should ignore the psychological aspects of the disorder', 'Fluoxetine is considered of benefit', 'The main treatment approach is diet control']\",\"question\":\"It is correct to state that for the treatment of Bulimia Nervosa:\\n \",\"src\":\"ori_mmlu-nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}