{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"add8096d-ad69-5d05-92c2-7c54414a1dc0","task_key":"default--test--3136","task_revision_id":"1","upstream_id":"3136","short_description":"The thymus gland is a two-lobed, glandular-appearing structure located in the…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Synthesizes vitamin D and aids in the digestion of fats', 'Secretes bile to help in digestion and stores nutrients', 'Acts as the primary site for the synthesis of blood platelets and filters out old red blood cells', 'Produces white blood cells and regulates body temperature', 'Produces antibodies for immune response and generates heat to maintain body temperature', \\\"Controls the body's metabolism and regulates calcium levels\\\", \\\"Regulates the body's salt and water balance and helps control blood volume\\\", 'Provides the initial supply of lymphocytes for other lymphoid areas and releases the hormone thymosin which stimulates the differentiation of incipient plasma cells in the lymphoid tissues', 'Produces hormones that regulate growth and development, and controls blood pressure', 'Produces insulin and glucagon to regulate blood sugar levels']\",\"question\":\"The thymus gland is a two-lobed, glandular-appearing structure located in the upper region of the chest just behind the sternum. What are the two principal functions that have been attributed to this gland?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}