{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3d7c6f3a-96d4-5efb-ba21-2178e85e0dc1","task_key":"default--test--2981","task_revision_id":"1","upstream_id":"2981","short_description":"Describe the differences between an element and a compound.","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Compounds are formed from elements through physical changes, such as freezing and melting.', \\\"An element's properties are the result of the combination of the properties of the compounds it contains.\\\", 'Elements are always liquid at room temperature, while compounds are always solid.', 'Compounds are substances that consist of identical molecules. Elements are made of two or more types of molecules combined randomly.', 'Compounds consist of identical atoms.', 'Elements are composed of multiple types of atoms.', 'Elements can be broken down into compounds through nuclear reactions, while compounds are indivisible.', 'Elements can be separated into simpler substances by chemical means, while compounds cannot.', 'Elements are substances that consist of identical atoms. A compound is a substance that is composed of two or more different kinds of atoms combined in a definite weight ratio.', 'Elements and compounds have the same atomic structure']\",\"question\":\"Describe the differences between an element and a compound.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}