{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5e21ef9e-243e-558b-ab63-6de781eee6a8","task_key":"default--test--3124","task_revision_id":"1","upstream_id":"3124","short_description":"What factors affect the rate of transpiration?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Temperature, humidity, and air currents', 'Plant species, root depth, and wind speed', 'Soil fertility, irrigation methods, and cloud cover', 'Water salinity, leaf color, and time of day', 'Leaf surface area, stem length, and moon phase', 'Soil pH, plant age, and rainfall', 'Atmospheric pressure, plant height, and sunlight', 'Sunlight, soil type, and plant species', 'Bark thickness, seed size, and ambient noise levels', 'Carbon dioxide levels, night temperature, and altitude']\",\"question\":\"What factors affect the rate of transpiration?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}