{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8b3b6c67-6a79-5561-a6c0-7bfe854048e4","task_key":"default--test--2845","task_revision_id":"1","upstream_id":"2845","short_description":"Why are the elements carbon, hydrogen, oxygen, and nitrogen (C, H, O, N) of…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['These elements are the only elements that can form gases at room temperature', 'These elements are abundant in living organisms, can readily form covalent bonds and are the lightest elements that can form such bonds.', 'These elements are the primary sources of energy for living organisms', 'These elements are radioactive, which is vital for cellular processes', 'These elements are capable of undergoing sublimation, which is crucial for life functions', 'These elements are rare and thus more valuable', 'These elements give color to living organisms', 'These elements can only be found in DNA and proteins', 'These elements are the heaviest elements in living organisms', 'These elements have magnetic properties that are essential for life']\",\"question\":\"Why are the elements carbon, hydrogen, oxygen, and nitrogen (C, H, O, N) of immense importance in living matter ?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}