{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7556db15-227c-510c-a50c-4ffa4e439a5d","task_key":"default--test--2913","task_revision_id":"1","upstream_id":"2913","short_description":"In aquatic plants, which haveprotoplasmsthatare hypertonic in comparison to the…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Osmotic pressure regulates the influx of water', 'Turgor pressure regulates the influx of water', 'Aquaporins regulate the influx of water', 'Active transport mechanisms regulate the influx of water', 'Plasmolysis regulates the influx of water', 'Capillary action regulates the influx of water', 'Diffusion of solutes regulates the influx of water', 'Guard cells regulate the influx of water', 'Contractile vacuoles regulate the influx of water', 'Cellulose wall regulates the influx of water']\",\"question\":\"In aquatic plants, which haveprotoplasmsthatare hypertonic in comparison to the water in which they live, the amount of water in the plant cells remains at a constant level . Explain how this is regulated.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}