{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5cfeab01-9007-53dd-aff2-a120721b19c1","task_key":"default--test--3176","task_revision_id":"1","upstream_id":"3176","short_description":"The volume of plasma and other extracellular fluids are regulated by automatic…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The controls are nerve impulses in the body', 'The controls are the contraction and relaxation cycles of skeletal muscles', 'The controls are hormonal responses that regulate digestion and absorption of food', 'The controls are mechanisms that regulate the heart rate', 'The controls are processes that control the body temperature', 'The controls are enzyme activities that facilitate cellular metabolism', 'The controls are the balance of electrolytes and the distribution of ions across cell membranes', 'The controls are chemical signals that manage blood glucose levels', 'The controls are mechanisms that regulate fluid movement in capillaries, filtration processes at the glomerulus-capsule junction, and baroreceptor responses in the walls of arteries.', 'The controls are the respiratory rate adjustments in response to oxygen demand']\",\"question\":\"The volume of plasma and other extracellular fluids are regulated by automatic feedback controls. What are these controls?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}