{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"93ee8ae6-8f30-5d1d-9083-01687f265348","task_key":"default--test--3126","task_revision_id":"1","upstream_id":"3126","short_description":"Adrenalin is a hormone which stimulates the sympathetic system . What effects…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['(a) Increases peristalsis and reduces secretion, (b) Causes both sets of muscles in the iris to relax, (c) Accelerates and weakens the heartbeat', '(a) Enhances digestion, (b) Causes the iris to change color, (c) Decreases the heart rate', '(a) No effect on the digestive tract, (b) Causes both sets of muscles in the iris to contract, (c) Slows the heart rate', '(a) Enhances digestion and secretion, (b) No effect on the muscles of the iris, (c) Accelerates the heart rate', '(a) No effect on the digestive tract, (b) Causes radial muscles to relax, resulting in constriction, (c) Decreases and strengthens the heartbeat', '(a) Slows peristalsis and reduces secretion, (b) Causes radial muscles to contract, resulting in dilation, (c) Accelerates and strengthens the heartbeat', '(a) Slows peristalsis and increases secretion, (b) Causes circular muscles to contract, resulting in dilation, (c) Slows and strengthens the heartbeat', '(a) Decreases peristalsis and has no effect on secretion, (b) Causes circular muscles to relax, resulting in dilation, (c) No change in the heart rate', '(a) Increases peristalsis and enhances secretion, (b) Causes circular muscles to contract, resulting in constriction, (c) Slows and weakens the heartbeat', '(a) Increases peristalsis and enhances secretion, (b) Causes radial muscles to contract, resulting in constriction, (c) Accelerates the heart rate without changing its strength']\",\"question\":\"Adrenalin is a hormone which stimulates the sympathetic system . What effects would you expect adrenaline tohave on (a) the digestive tract, (b) the iris of the eye, and (c) the heart beat?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}