{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5022d2d6-93bf-56e9-9f3b-f9890a0e55f7","task_key":"default--test--6699","task_revision_id":"1","upstream_id":"6699","short_description":"It is correct to state that for the treatment of Bulimia Nervosa:","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['It is not useful to discuss weight with patients', 'Treatment should focus solely on physical symptoms', 'Therapies should primarily focus on food avoidance tactics', 'Use of antipsychotic medication is first-line treatment', 'The first approach is to discuss body image', 'Fluoxetine is considered of benefit', \\\"Treatment should prioritize on patients' social relationships\\\", 'Treatments should target exclusively on purging practices', 'The main treatment approach is diet control', 'Treatment should ignore the psychological aspects of the disorder']\",\"question\":\"It is correct to state that for the treatment of Bulimia Nervosa:\\n\",\"src\":\"ori_mmlu-nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}