{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ce922891-1fdb-5bec-9cf2-4e369ce8a29d","task_key":"default--test--2876","task_revision_id":"1","upstream_id":"2876","short_description":"How do anesthetics act to reduce or eliminate thesensation of pain?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Anesthetics alter the pH levels in nervous tissue', 'Anesthetics damage the nerve fibers', 'Anesthetics compete with neurotransmitters at receptor sites', 'Anesthetics stimulate the release of endorphins to mask pain', 'Anesthetics enhance the pain threshold of the central nervous system', 'Anesthetics block the nerve impulses from reaching the brain', 'Anesthetics increase the amount of neurotransmitter in the synapse', 'Anesthetics slow down the blood flow to the brain', 'Anesthetics dull the sense organs', 'Anesthetics cause temporary paralysis of muscle groups']\",\"question\":\"How do anesthetics act to reduce or eliminate thesensation of pain?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}