{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1a15814a-85c4-5377-8ec1-e732cca427b5","task_key":"default--test--2959","task_revision_id":"1","upstream_id":"2959","short_description":"The parathyroid glands in man are small, pealike organs. They are ususally four…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The parathyroid glands produce insulin to regulate blood sugar levels', 'The parathyroid glands regulate blood pressure', 'The parathyroid glands control breathing rate', 'The parathyroid glands secrete enzymes that break down proteins', 'The parathyroid glands control the balance of electrolytes in the body', 'The parathyroid glands secrete hormones that stimulate red blood cell production', 'The parathyroid glands are responsible for filtering waste from the blood', 'The parathyroid glands regulate the calcium-phosphate balance between the blood and other tissues', 'The parathyroid glands regulate body temperature', 'The parathyroid glands aid in digestion']\",\"question\":\"The parathyroid glands in man are small, pealike organs. They are ususally four in number and are located on the surface of the thyroid. What is the function of these glands?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}