{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d30e6663-a86b-5c35-9ad9-d5389c70b51a","task_key":"default--test--3363","task_revision_id":"1","upstream_id":"3363","short_description":"The heart does not extract oxygen and nutrients from the blood within the atria…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The heart synthesizes its own nutrients internally without reliance on external sources.', 'The heart relies on neural control for its metabolic needs.', 'The heart extracts nutrients from the atria and ventricles.', \\\"The heart's metabolic needs are met by the lymphatic system.\\\", 'The heart depends on its own blood supply from the coronary vessels.', 'The heart utilizes osmosis to draw nutrients from the surrounding tissues.', 'The heart absorbs nutrients directly from the pericardial fluid.', 'The heart gets its metabolic needs from the lungs.', 'The heart is supplied by diffusion of nutrients from the bloodstream within the chambers.', 'The heart receives its metabolic needs from the aorta directly.']\",\"question\":\"The heart does not extract oxygen and nutrients from the blood within the atria and ventricles. How is the heart sup-plied with its metabolic needs?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}