{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"08012b43-2992-5bc5-b57c-ff1d6f44bc0e","task_key":"default--test--6009","task_revision_id":"1","upstream_id":"6009","short_description":"An action potential arriving at the motor endplate causes release of:","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['adrenaline which speeds up muscle metabolism.', 'noradrenaline which increases muscle metabolic activity.', 'sodium ions which binds to sodium receptors on the muscle membrane.', 'acetylcholine which traverses the neuromuscular junction.', 'acetylcholine which is broken down by acetylcholinesterase in the synaptic cleft.', 'calcium ions which initiate an action potential along the muscle fibre.', 'dopamine which initiates muscle contraction.', 'serotonin which reduces muscle excitability.', 'potassium ions which hyperpolarize the muscle membrane.', 'glutamate which acts as a neurotransmitter at the neuromuscular junction.']\",\"question\":\"An action potential arriving at the motor endplate causes release of:\",\"src\":\"ori_mmlu-college_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}