{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"51af1daf-9e8b-5a5e-86e0-6097e91a3433","task_key":"default--test--3178","task_revision_id":"1","upstream_id":"3178","short_description":"What is the physiological basis of allergies? What measures can be taken to…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Allergies are adverse immunological responses to antigens. Antihistamines and desensitization therapy can help decrease the effect of allergies.', \\\"Allergies are triggered by the body's overproduction of white blood cells. Avoiding allergens and taking vitamin supplements can decrease the effect of allergies.\\\", 'Allergies are caused by genetic mutations and can be minimized by regular exercise and a healthy diet.', 'Allergies can be fully cured with antihistamines.', 'Allergies are caused by exposure to pathogens.', 'Allergies develop due to an overactive nervous system. Beta-blockers and nerve-calming medications can help mitigate the effects of allergies.', 'Allergies are a result of lack of immune response.', 'Allergies are psychosomatic and can be managed through stress reduction techniques and meditation.', \\\"Allergies result from the body's inability to produce sufficient antibodies. Immunoglobulin therapy can help decrease the effect of allergies.\\\", \\\"Allergies are the body's natural response to environmental pollutants. Using air purifiers and avoiding outdoor activities can reduce allergy symptoms.\\\"]\",\"question\":\"What is the physiological basis of allergies? What measures can be taken to decrease the effect of allergies?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}