{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3568c27c-2b66-58c3-bc91-8abcc0a2b98f","task_key":"default--test--11404","task_revision_id":"1","upstream_id":"11404","short_description":"Consider a double layered wall. Theemissivitiesof the outer andinner layer are…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['21.64 Btu/hr ft^2 and 1.66 Btu/hr ft^2', '25.64 Btu/hr ft^2 and 1.46 Btu/hr ft^2', '27.64 Btu/hr ft^2 and 2.06 Btu/hr ft^2', '18.64 Btu/hr ft^2 and 0.96 Btu/hr ft^2', '19.64 Btu/hr ft^2 and 1.06 Btu/hr ft^2', '22.64 Btu/hr ft^2 and 1.56 Btu/hr ft^2', '26.64 Btu/hr ft^2 and 1.76 Btu/hr ft^2', '23.64 Btu/hr ft^2 and 1.36 Btu/hr ft^2', '20.64 Btu/hr ft^2 and 1.26 Btu/hr ft^2', '24.64 Btu/hr ft^2 and 1.86 Btu/hr ft^2']\",\"question\":\"Consider a double layered wall. Theemissivitiesof the outer andinner layer are 0.85 and 0.46, respectively. The ambient temperatureis 110°F and the temperature inside the room is 60°F.Calculate the radiant heat flux per unit area. Also, calculatethe radiant heat flux when an aluminium radiation shieldhaving\\\\epsilon_s= 0.05 is used.\",\"src\":\"stemez-HeatTransfer\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}