{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"64dea48a-559f-5390-a937-e24a65a74116","task_key":"default--test--11364","task_revision_id":"1","upstream_id":"11364","short_description":"A turbine takes in air at 825K, 690kPaand expands it to 138 kPaand 585K.…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['290.5 kJ/kg, -75.4 kJ/kg, 515.9K', '315.5 kJ/kg, -55.4 kJ/kg, 510.9K', '295.5 kJ/kg, -60.4 kJ/kg, 500.9K', '280.5 kJ/kg, -65.4 kJ/kg, 540.9K', '300.5 kJ/kg, -70.4 kJ/kg, 525.9K', '250.5 kJ/kg, -65.4 kJ/kg, 530.9K', '305.5 kJ/kg, -60.4 kJ/kg, 520.9K', '310.5 kJ/kg, -80.4 kJ/kg, 505.9K', '275.5 kJ/kg, -55.4 kJ/kg, 545.9K', '320.5 kJ/kg, -50.4 kJ/kg, 535.9K']\",\"question\":\"A turbine takes in air at 825K, 690kPaand expands it to 138 kPaand 585K. Assuming air to be an ideal gas, calculate a) the available energy of the air taken in, b) the loss of available energy in the turbine, and c) T_0, the isentropic exit temperature, or, the lowest available temperature.\",\"src\":\"stemez-Thermodynamics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}