{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e6aa86a3-090a-559a-9062-cdbd233f439f","task_key":"default--test--3019","task_revision_id":"1","upstream_id":"3019","short_description":"How do the algae differ from the fungi in their method of obtaining food?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Algae use phagocytosis to ingest food particles, while fungi use mycorrhizal associations to obtain nutrients', 'Both algae and fungi are heterotrophs', 'Algae obtain food through chemosynthesis, while fungi obtain food through absorption', 'Both algae and fungi obtain food through ingestion of other organisms', 'Algae consume food by absorption, while fungi synthesize their own food through photosynthesis', 'Both algae and fungi are autotrophs', 'Algae are autotrophs and fungi are heterotrophs', 'Fungi are parasites and algae are saprophytes', 'Algae are decomposers and fungi are photosynthetic', 'Algae are heterotrophs and fungi are autotrophs']\",\"question\":\"How do the algae differ from the fungi in their method of obtaining food?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}