{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"625c079c-c645-5db1-864e-827081dc3908","task_key":"default--test--2950","task_revision_id":"1","upstream_id":"2950","short_description":"How do the fork ferns differ from the true ferns? What unusual feature is…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Psilotum has no leaves or roots, and reproduces with flowers and seeds.', 'The fork ferns have small, simple, scale-like leaves and lack well-developed roots, instead having numerous unicellular rhizoids. They also have a rhizome often associated with a fungus. Psilotum has vascular tissues in both its gametophyte and sporophyte.', 'Psilotum has a well-developed root system similar to that of flowering plants.', 'The fork ferns have a rhizome usually found in association with an animal.', 'Psilotum lacks vascular tissues in both its gametophyte and sporophyte.', 'The fork ferns have a symbiotic relationship with insects for pollination.', 'The fork ferns have large, compound leaves and well-developed roots.', 'The fork ferns produce seeds, unlike the true ferns which reproduce via spores.', 'The fork ferns reproduce only via spores, while true ferns reproduce both sexually and asexually.', 'The fork ferns have vascular tissues only in their sporophyte, while Psilotum has them in neither generation.']\",\"question\":\"How do the fork ferns differ from the true ferns? What unusual feature is present inPsilotum?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}