{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"715095ed-edfb-57ac-b70c-3072d86939f5","task_key":"default--test--3001","task_revision_id":"1","upstream_id":"3001","short_description":"Which of the following is a correct statement about the cohesion-tension theory…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Living cells of the phloem provide the main conduit for an ascent of water.', 'Water moves from a sink region with high hydrostatic pressure to a source region with low hydrostatic pressure.', 'The cohesion of water molecules is responsible for the formation of embolisms (air bubbles) in the water column.', 'The cohesion of water molecules prevents tension in the water column.', 'The evaporation of water from leaf mesophyll cells prevents tension in the water column.', 'Living cells of the xylem provide the main conduit for an ascent of water.', 'The cohesion-tension theory states that water rises in the xylem due to the gravitational pull.', 'The evaporation of water from leaf mesophyll cells generates tension in the water column.']\",\"question\":\"Which of the following is a correct statement about the cohesion-tension theory for the ascent of water in the xylem?\",\"src\":\"ori_mmlu-college_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}