{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1111582c-536b-5225-ad8b-84e813bd86b2","task_key":"default--test--3063","task_revision_id":"1","upstream_id":"3063","short_description":"Why is it that in most ecological successions the last stageis longlasting?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The climax stage is characterized by rapid species turnover and high instability', 'Successional stages progress more rapidly as they approach the climax stage', 'Climax community is more prone to environmental changes', 'Climax communities are less resilient to disturbances', 'Climax community is more stable, has complex organization, larger organic structure, and more balanced metabolism', 'Climax communities are dominated by early-successional species', 'Climax stage is short-lived', 'Climax communities are static and unchanging', 'Climax communities have fewer species and simpler interactions', 'Each successional stage is equally likely to be long-lasting']\",\"question\":\"Why is it that in most ecological successions the last stageis longlasting?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}