{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b3b73369-d2fe-5332-8b7e-27a5ee06b769","task_key":"default--test--3416","task_revision_id":"1","upstream_id":"3416","short_description":"Why does milk \\textquotedblleftspoil\\textquotedblright when kept in a…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Milk spoils due to high temperatures', 'Milk spoils exclusively due to the separation of fat content at lower temperatures', 'Milk spoils because of thermophilic bacteria', 'Psychrophilic bacteria cause milk to spoil in cool temperatures.', 'Milk spoils as a result of exposure to light inside the refrigerator', 'Spoilage occurs due to an increase in pH levels over time, regardless of temperature', 'Milk spoils due to chemical reactions', \\\"Milk spoils due to oxygenation through the container's permeability\\\", 'Enzymatic activity from feed consumed by cows causes milk to spoil in the fridge', 'Milk spoils because of the absorption of refrigerator odors']\",\"question\":\"Why does milk \\\\textquotedblleftspoil\\\\textquotedblright when kept in a refrigerator?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}