{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c54857bd-c535-5e7f-8c63-919245601e62","task_key":"default--test--3473","task_revision_id":"1","upstream_id":"3473","short_description":"What properties of water make it an essential component of living matter?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Water is useful just because of its cooling properties.', 'Water is only important for hydration.', \\\"Water's role is limited to acting as a chemical reactant in cellular processes.\\\", 'Water is important primarily because it contributes to the structural rigidity of cells.', \\\"Water's only function is to provide a medium for aquatic organisms.\\\", 'Water is essential because it is the only liquid found naturally on Earth.', 'Water is essential only because it is a good solvent.', \\\"Water's significance is due to its high compressibility, which is vital for life.\\\", 'Water is the most abundant molecule in the cell, an excellent solvent for living systems, has high heat capacity, functions in heat regulation, serves as a lubricant, and aids in the transport of nutrients.', 'Water is vital because it is the least reactive chemical compound, preventing unwanted reactions in living matter.']\",\"question\":\"What properties of water make it an essential component of living matter?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}