{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"478ba1e3-e8c4-5f64-9ff6-00ff2ac935d6","task_key":"default--test--1999","task_revision_id":"1","upstream_id":"1999","short_description":"Electrical stimulation of the brain for the treatment of chronic pain","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['is not effective and can lead to further health complications', 'is of no practical significance, since it can only provide temporary relief.', 'may produce its effects by suppressing the central nervous system', 'is of no practical significance, since stimulation-produced analgesia has been demonstrated only in rats', 'may produce its effects by blocking the pain signals to the brain', 'is generally effective, but medically ill-advised because such stimulation has aversive properties', 'is generally effective, but can lead to addiction', 'may produce its effects by promoting the release of the neurotransmitter norepinephrine', 'may produce its effects by promoting the release of the neurotransmitter serotonin']\",\"question\":\"Electrical stimulation of the brain for the treatment of chronic pain\",\"src\":\"ori_mmlu-professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}