{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ebb8b8b0-dc5e-5268-a7ef-7cf205a18f2a","task_key":"default--test--3141","task_revision_id":"1","upstream_id":"3141","short_description":"Compare cardiac muscle to skeletal and smooth muscle.","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Cardiac muscle has a metabolism similar to smooth muscle, designed for quick, short bursts of activity.', 'Cardiac muscle cells are multinucleated and arranged in a non-striated pattern.', 'Cardiac muscle shows some characteristics of both skeletal and smooth muscle. It is striated, has numerous nuclei per cell, is innervated by the autonomic nervous system, has intercalated discs, and its metabolism is designed for endurance.', 'Cardiac muscle lacks intercalated discs, which differentiates it from skeletal and smooth muscle.', 'Cardiac muscle does not have any similarities with skeletal and smooth muscle', 'Cardiac muscle is innervated by the somatic nervous system, similar to skeletal muscle.', 'Cardiac muscle is similar to skeletal muscle but not smooth muscle', 'Cardiac muscle has a metabolism designed for speed and strength', 'Cardiac muscle is not striated and has a single nucleus per cell, similar to smooth muscle.', 'Cardiac muscle is identical to smooth muscle in both structure and function.']\",\"question\":\"Compare cardiac muscle to skeletal and smooth muscle.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}