{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"537e408b-8312-557a-91ee-dac64dff5bf6","task_key":"default--test--12199","task_revision_id":"1","upstream_id":"12199","short_description":"A chamber contains 5 lbm of an ideal gas, initially at a temperature of 100°F.…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['200°F', '400°F', '500°F', '300°F']\",\"question\":\"A chamber contains 5 lbm of an ideal gas, initially at a temperature of 100°F. The gas then undergoes a reversible isobaric process during which 500 Btu are added to the gas as heat. Determine the final temperature of the gas, assuming that the following properties of the gas are known. R = 0.0641 Btu/lbm -°R[0.2684 kJ/kg-°K] k = 1.147\",\"src\":\"stemez-Thermodynamics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}