{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6f417d07-7665-5553-b628-ed6174ca08b0","task_key":"default--test--2963","task_revision_id":"1","upstream_id":"2963","short_description":"How are fungi important to man?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Fungi are only harmful to humans', 'Fungi contribute to human health by only causing diseases.', 'Fungi play a role only in the production of bread and have no impact on other food industries or agriculture.', 'Fungi have no impact on agriculture', 'Fungi are only used in liquor production', 'Fungi are essential for animal survival but have no use in human industries.', 'Fungi solely act as decomposers and have no other roles in human activities.', 'Fungi are used exclusively in the production of antibiotics and have no other applications.', 'Fungi are both beneficial and detrimental to man. They are used in food production, liquor and bread manufacture, cheese production, and are also of agricultural importance. Certain fungi can cause serious damage to crops and cause diseases in humans and livestock.', 'All fungi are edible and provide significant nutritional value to humans.']\",\"question\":\"How are fungi important to man?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}