{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"24e81605-c00e-5753-9166-db96937284ae","task_key":"default--test--2971","task_revision_id":"1","upstream_id":"2971","short_description":"What properties of water make it an essential component of living matter?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Water serves as a poor solvent', 'Water has a high compressibility that allows it to act as a cushion for cellular structures.', 'Water is a strong acid, contributing to the chemical reactions in the cell.', 'Water is scarce in cells', 'Water is a poor conductor of electricity, which is essential for nerve impulse transmission.', 'Water is the most abundant molecule in the cell, an excellent solvent, has a high heat capacity, serves in heat regulation, as a lubricant, and in the transport of nutrients.', 'Water has a low surface tension, which does not support capillary action.', 'Water is immiscible with many organic compounds, preventing reactions within cells.', 'Water has a low boiling point, which helps to maintain cellular temperature under extreme heat conditions.', 'Water has a low heat capacity']\",\"question\":\"What properties of water make it an essential component of living matter?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}