{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ae30706f-74f0-56b2-8f8a-15aef853725f","task_key":"default--test--3229","task_revision_id":"1","upstream_id":"3229","short_description":"Explain why simple diffusion is not sufficient to account for the passage of all…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Simple diffusion can only transport minerals when they are bound to oxygen molecules', 'Simple diffusion cannot occur against a concentration gradient', 'Simple diffusion requires specific carrier proteins for each mineral', 'Simple diffusion only works for organic compounds, not inorganic minerals', 'Simple diffusion can transport minerals in any concentration', 'Simple diffusion cannot differentiate between beneficial minerals and toxins', 'Simple diffusion can only occur in water plants', 'Simple diffusion is too slow for transporting large quantities of minerals', 'Simple diffusion requires energy', 'Simple diffusion is only possible in animal cells, not in plant cells']\",\"question\":\"Explain why simple diffusion is not sufficient to account for the passage of all of the dissolved minerals into the cells of water plants.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}