{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c8945ea0-a49c-5677-938b-68b1d5c85561","task_key":"default--test--2968","task_revision_id":"1","upstream_id":"2968","short_description":"Why does milk \\textquotedblleftspoil\\textquotedblright when kept in a…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Lactose crystallization at low temperatures causes milk to spoil', 'Milk spoils due to absorption of odors in the fridge', 'Milk spoils due to the presence of mesophiles', 'Milk spoils due to chemical reactions in the fridge', 'Thermophiles cause milk to spoil in the refrigerator', 'Milk spoils due to the activation of dormant bacteria at refrigerator temperatures', 'Enzymes in the refrigerator cause milk to spoil', 'Milk spoils exclusively due to the separation of fat content at lower temperatures', 'Psychrophilic bacteria spoil milk in the cool temperatures of a refrigerator', 'Ultraviolet light inside the refrigerator accelerates spoilage']\",\"question\":\"Why does milk \\\\textquotedblleftspoil\\\\textquotedblright when kept in a refrigerator?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}