{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"608edafd-635b-5e3a-91a8-6f667d5bbc96","task_key":"default--test--6480","task_revision_id":"1","upstream_id":"6480","short_description":"Which statement concerning the atrioventricular bundle is correct?","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['It is formed of autonomic nerve processes and forms one of several electrical connections between the atria and ventricles.', 'It is formed of Purkinje fibres and forms one of several electrical connections between the left atrium and the left ventricle.', 'It is formed of Purkinje fibres and has no electrical connection between the atria and the ventricles.', 'It is formed of autonomic nerve processes and forms one of several electrical connections between the right atrium and the right ventricle.', 'It is formed of Purkinje fibres and forms one of several electrical connections between the atria and ventricles.', 'It is formed of cardiac muscle cells and forms one of several electrical connections between the atria and ventricles.', 'It is formed of Purkinje fibres and is the only electrical connection between the atria and the ventricles', 'It is formed of autonomic nerve processes and is the only electrical connection between the left atrium and the left ventricle.', 'It is formed of muscle fibres and is the only electrical connection between the atria and the ventricles.', 'It is formed of autonomic nerve processes and is the only electrical connection between the atria and the ventricles.']\",\"question\":\"Which statement concerning the atrioventricular bundle is correct?\",\"src\":\"ori_mmlu-anatomy\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}