{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f746cdf4-3beb-5c7b-aba0-5bf1452e1823","task_key":"default--test--3513","task_revision_id":"1","upstream_id":"3513","short_description":"What properties of water make it an essential component of living matter?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Water is abundant, a good solvent, regulates heat, serves as a lubricant, aids in transport of nutrients, and maintains osmotic relationships.', 'Water is detrimental to the regulation of heat in the body.', 'Water is a poor solvent, making it unsuitable for chemical reactions in cells.', 'Water provides no thermal insulation and cannot dissolve gases.', 'Water is not involved in maintaining structural integrity of biological molecules.', 'Water is only involved in the transport of nutrients, but has no role in heat regulation or as a solvent.', 'Water is scarce and difficult to dissolve substances in.', \\\"Water's high surface tension is detrimental to the movement of substances in living organisms.\\\", 'Water has a low heat capacity, which makes it ineffective in temperature regulation.', 'Water serves no functional purpose in living organisms.']\",\"question\":\"What properties of water make it an essential component of living matter?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}