{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"596f9f5f-e6b8-51ec-9d2b-2766272003aa","task_key":"default--test--3259","task_revision_id":"1","upstream_id":"3259","short_description":"Why are the elements carbon, hydrogen, oxygen, and nitrogen (C, H, O, N) of…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['These elements make up the majority of non-living matter.', 'Carbon, hydrogen, oxygen and nitrogen are the four most abundant elements in living organisms, make up about 99 percent of the mass of most cells, and can readily form covalent bonds by electron pair sharing.', 'These elements are rare and precious.', 'They are noble gases that are crucial for maintaining the structure of proteins.', 'These elements are responsible for the magnetic properties of living organisms.', 'These elements are heavy metals that are essential for building DNA and RNA structures.', 'These elements cannot form covalent bonds.', 'Carbon, hydrogen, oxygen, and nitrogen are the only elements that organisms need for survival.', 'These elements are only important for their radioactive properties.', 'Carbon, hydrogen, oxygen, and nitrogen are the only elements that can form ionic bonds.']\",\"question\":\"Why are the elements carbon, hydrogen, oxygen, and nitrogen (C, H, O, N) of immense importance in living matter ?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}