{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1d073e7e-8187-5033-94c6-6fcd5dfbdcad","task_key":"default--test--2877","task_revision_id":"1","upstream_id":"2877","short_description":"In humans, the liver is one of the largest and most active organsin the body.…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The liver only detoxifies harmful substances.', 'The liver filters out red blood cells, produces urine, and regulates body temperature.', 'The liver produces insulin and glucagon, regulates carbohydrate metabolism, and stores vitamins.', 'The liver is mainly responsible for the production of bile.', 'The liver regulates the level of glucose in the blood, converts glucose into fat, produces bile, detoxifies ammonia, produces cholesterol, plays roles in blood clotting, and is involved in the activation of vitamin D.', 'The liver synthesizes proteins for muscle development and stores excess glucose as glycogen.', \\\"The liver's main function is the regulation of glucose levels.\\\", \\\"The liver is involved in the synthesis of growth hormones and the regulation of the body's immune response.\\\", 'The liver is responsible for the production of digestive enzymes and the absorption of nutrients.', \\\"The liver's primary role is to break down muscle tissue and recycle red blood cells.\\\"]\",\"question\":\"In humans, the liver is one of the largest and most active organsin the body. Describe its functions.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}