{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"052b1429-ac66-5fa7-8455-268ffda452a3","task_key":"default--test--2965","task_revision_id":"1","upstream_id":"2965","short_description":"Besides temperature, what other physical conditions must be taken into account…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Levels of oxygen, acidity or alkalinity of the medium', 'Temperature changes, light exposure', 'Atmospheric pressure, noise levels', 'Nitrogen levels, radiation exposure', 'Soil texture, light wavelength', 'Levels of carbon dioxide, humidity', 'Water activity, presence of specific nutrients', 'Magnetic fields, altitude', 'Barometric pressure, salinity of water', 'Light exposure, humidity']\",\"question\":\"Besides temperature, what other physical conditions must be taken into account for the growth of bacteria?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}