{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1f954142-4b96-5f55-b953-99050ac6a9f2","task_key":"default--test--2506","task_revision_id":"1","upstream_id":"2506","short_description":"The most common treatment for ADHD is drug treatment using CNS stimulants. In…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['For reducing activity levels a higher dose of the stimulant is required.', 'Stimulant therapy is only effective for adult ADHD, not for children.', 'A higher dose of the treatment leads to severe physical dependency.', 'A limitation of stimulant therapy is that not all children improve.', 'The treatment does not improve attention span.', 'Improvements may only be short-lived following treatment.', 'A lower dose of the treatment has the effect of improving social behaviors.', 'Stimulant therapy is known to worsen ADHD symptoms.', 'The treatment has no side effects.']\",\"question\":\"The most common treatment for ADHD is drug treatment using CNS stimulants. In relation to treatment for ADHD which of the following statements is incorrect?\",\"src\":\"ori_mmlu-professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}