{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4eebaba7-2f4a-5c51-881c-f640e134cfb6","task_key":"default--test--11595","task_revision_id":"1","upstream_id":"11595","short_description":"An air-water-vapor mixture at 1atmand 75°F has a relative humidity of 0.45. For…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['Specific humidity: 8.297 × 10^-3 lbmwater/lbmair, Dew point: 52.15°F, Partial pressures: 0.1935pisa (water), 14.5065pisa (air)', 'Specific humidity: 8.297 × 10^-3 lbmwater/lbmair, Dew point: 52.15°F, Partial pressures: 0.2935pisa (water), 14.4065pisa (air)', 'Specific humidity: 8.000 × 10^-3 lbmwater/lbmair, Dew point: 53.00°F, Partial pressures: 0.2050pisa (water), 14.4950pisa (air)', 'Specific humidity: 9.100 × 10^-3 lbmwater/lbmair, Dew point: 58.00°F, Partial pressures: 0.2100pisa (water), 14.4900pisa (air)', 'Specific humidity: 9.500 × 10^-3 lbmwater/lbmair, Dew point: 60.00°F, Partial pressures: 0.2200pisa (water), 14.4800pisa (air)', 'Specific humidity: 8.297 × 10^-3 lbmwater/lbmair, Dew point: 55.15°F, Partial pressures: 0.1935pisa (water), 14.5065pisa (air)', 'Specific humidity: 6.500 × 10^-3 lbmwater/lbmair, Dew point: 48.00°F, Partial pressures: 0.1800pisa (water), 14.5200pisa (air)', 'Specific humidity: 7.000 × 10^-3 lbmwater/lbmair, Dew point: 49.00°F, Partial pressures: 0.1850pisa (water), 14.5150pisa (air)', 'Specific humidity: 7.297 × 10^-3 lbmwater/lbmair, Dew point: 50.15°F, Partial pressures: 0.1935pisa (water), 14.5065pisa (air)', 'Specific humidity: 7.800 × 10^-3 lbmwater/lbmair, Dew point: 51.00°F, Partial pressures: 0.2000pisa (water), 14.5000pisa (air)']\",\"question\":\"An air-water-vapor mixture at 1atmand 75°F has a relative humidity of 0.45. For this mixture, calculate the specific humidity, the dew point and the partial pressures.\",\"src\":\"stemez-Thermodynamics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}