{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d33727ed-d693-5ba2-b014-06df249024c0","task_key":"default--test--11449","task_revision_id":"1","upstream_id":"11449","short_description":"The air used for the combustion of a hydrocarbon was suppliedat 25°C and…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['Carbon / Hydrogen ratio: 7.67, Theoretical air percentage: 125.3%', 'Carbon / Hydrogen ratio: 5.67, Theoretical air percentage: 120.3%', 'Carbon / Hydrogen ratio: 6.67, Theoretical air percentage: 110.3%', 'Carbon / Hydrogen ratio: 6.17, Theoretical air percentage: 100.3%', 'Carbon / Hydrogen ratio: 6.67, Theoretical air percentage: 115.3%', 'Carbon / Hydrogen ratio: 7.67, Theoretical air percentage: 90.3%', 'Carbon / Hydrogen ratio: 7.17, Theoretical air percentage: 110.3%', 'Carbon / Hydrogen ratio: 5.67, Theoretical air percentage: 105.3%', 'Carbon / Hydrogen ratio: 8.67, Theoretical air percentage: 95.3%', 'Carbon / Hydrogen ratio: 4.67, Theoretical air percentage: 130.3%']\",\"question\":\"The air used for the combustion of a hydrocarbon was suppliedat 25°C and 100kPawith a relative humidity of 48%. Determine (a) the carbon / hydrogen ratio of the fuel on amass basis and (b) the percent theoretical air employed in thecombustion process, if an analysis of the products of combustionyields the following volumetric composition on a drybasis: CO_2 - - 13.0%; O_2 - - 3.1%; CO - - 0.3%.N_2 - - 83.6%\",\"src\":\"stemez-Thermodynamics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}