{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"70afc465-734d-5fd6-940d-81ed8d80094b","task_key":"default--test--3415","task_revision_id":"1","upstream_id":"3415","short_description":"All of the algae have the green pigment chlorophyll, yet the different phyla of…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Different algae phyla contain a variety of pigments, including accessory pigments, in varying concentrations resulting in different colors. These pigments absorb different light wavelengths and play roles in photosynthesis.', 'Algal colors change with the seasons, similar to leaves on a tree.', 'All algae only have green pigments', 'The color of algae is due to the surrounding environment', 'Algae can camouflage their color to match their surroundings, leading to diversity in appearance.', 'Different colors in algae are a result of different water temperatures they live in.', 'The intensity of sunlight exposure alters the green pigment, causing variations in color.', 'Different colors in algae are due to genetic mutations', 'The presence of various minerals in the water contributes to the color differences in algae.', 'Color variations in algae are due to the depth at which they are found in the water, as different colors penetrate water to different depths.']\",\"question\":\"All of the algae have the green pigment chlorophyll, yet the different phyla of algae show a great variety of colors. Explain.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}