{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"28e49959-72f8-588a-a39a-a6df753fea3f","task_key":"default--test--2902","task_revision_id":"1","upstream_id":"2902","short_description":"Describe the kingdoms within which algae are classified.","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Algae are classified under the Fungi, Plantae, and Archaea kingdoms.', 'Algae are categorized solely within the Bacteria kingdom.', 'Algae are only classified under the Plant kingdom.', 'Algae fall into the Animal, Fungi, and Protista kingdoms.', 'Algae are exclusively part of the Protista kingdom, with no sub-kingdom classifications.', 'Algae are divided among the Protista, Fungi, and Viruses kingdoms.', 'Algae are grouped into the Animalia, Plantae, and Protista kingdoms.', 'Algae fall into the Plant, Protistan, and Monera kingdoms, including the Chlorophyta, Rhodophyta, Phaeophyta, Euglenophyta, Chrysophyta, Pyrrophyta, and Cyanophyta.', 'Algae are classified under the Plant, Animal and Fungi kingdoms.', 'Algae fall into the Protista, Bacteria, and Archaea kingdoms.']\",\"question\":\"Describe the kingdoms within which algae are classified.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}