{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3b6c22c9-2b82-5513-b812-526cc6faede1","task_key":"default--test--11706","task_revision_id":"1","upstream_id":"11706","short_description":"What is steady state heat transfer?","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['Steady state heat transfer is when the rate of energy in equals the rate of energy out, with no accumulation of energy.', 'Steady state heat transfer is when the rate of energy in is less than the rate of energy out', 'Steady state heat transfer is when the temperature within the system is not uniform', 'Steady state heat transfer occurs only when there is no heat transfer', 'Steady state heat transfer is when energy is not conserved', 'Steady state heat transfer is when the temperature of the system continuously increases over time', 'Steady state heat transfer is when the rate of energy out is twice the rate of energy in', 'Steady state heat transfer is when the system only absorbs energy without releasing any', 'Steady state heat transfer is when the rate of energy in is zero, but the system continues to emit energy', 'Steady state heat transfer is when energy accumulates']\",\"question\":\"What is steady state heat transfer?\",\"src\":\"stemez-HeatTransfer\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}