{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0ebed33f-76df-5fc3-a6f1-d2e91806245c","task_key":"default--test--3187","task_revision_id":"1","upstream_id":"3187","short_description":"Algae may be microscopic single-celled organisms or…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['A plant body shows differentiation of parts, with its roots, stems, and leaves all varying greatly in structure and in function. Multicellular algae show very little, if any, tissue differentiation.', 'Algae have a more complex structure than plants', 'A thallus has a rigid cell wall made of cellulose, which is absent in plant cells', 'A thallus consists of a single layer of cells, unlike the multilayered tissues of plants', 'Algae possess true flowers and seeds, which differentiates them from plants', 'Algae cells are much smaller than plant cells', 'Algae have vascular systems similar to plants for transporting nutrients', 'Algae bodies are typically organized into root-like, stem-like, and leaf-like structures', 'Algae are capable of photosynthesis while plants are not', 'Algae perform cellular respiration, while plants only perform photosynthesis']\",\"question\":\"Algae may be microscopic single-celled organisms or enormousmulticellularseaweeds hundreds of feet long. The body of one of these organisms is termed athallus. How does athallusdiffer from a plant body?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}