{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"036d7cf3-4298-57c9-808f-1f4607dcd97d","task_key":"default--test--3916","task_revision_id":"1","upstream_id":"3916","short_description":"What do the differences in properties between lithium acetyl acetone (m.p. very…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['Both are non-ionic compounds', 'Lithium acetylacetonate is non-ionic and beryllium acetylacetonate is ionic', 'Both are ionic compounds', 'Lithium acetylacetonate is soluble in chloroform due to its polar nature, while beryllium acetylacetonate is not', 'Beryllium acetylacetonate is polymeric due to hydrogen bonding, whereas lithium acetylacetonate is not', 'Both exhibit similar degrees of ionic character and solubility properties', 'Beryllium acetylacetonate is a volatile liquid at room temperature, while lithium acetylacetonate is a high melting solid', 'Lithium acetylacetonate is ionic or salt-like and beryllium acetylacetonate is non-ionic or covalent', 'Lithium acetylacetonate is a polymeric compound, while beryllium acetylacetonate is monomeric', 'Both are polymeric in nature with extensive hydrogen bonding']\",\"question\":\"What do the differences in properties between lithium acetyl acetone (m.p. very high, insoluble in chloroform) and beryllium acetyl acetone (m.p. 108°,b.p. 270°, soluble in chloroform) suggest about their structures?\",\"src\":\"stemez-OrganicChemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}