{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b0ba1fdb-b4e8-5993-9c92-4bf3b588f917","task_key":"default--test--3414","task_revision_id":"1","upstream_id":"3414","short_description":"How do higher plants get rid of their waste products?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Plants expel waste by excreting it through flowers', 'Plants dispose of waste by burying it in the soil', 'Plants filter waste through their root system, purifying it before releasing it back into the soil', 'Plants convert all waste into oxygen through photosynthesis', 'Plants get rid of their waste products through diffusion via the pores of the leaves or root cells into the soil, and by shedding leaves.', 'Plants get rid of waste by converting it into energy', 'Plants transport waste to their stem where it crystallizes and is stored', 'Plants eliminate waste through burning it', 'Plants release waste products into the air as smoke']\",\"question\":\"How do higher plants get rid of their waste products?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}