{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"07eca045-f86f-5e84-bc35-b68b0b45ea09","task_key":"default--test--9591","task_revision_id":"1","upstream_id":"9591","short_description":"A camper stranded in snowy weather loses heat by wind convection. The camper is…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['55 g', '44 $\\\\\\\\mathrm{~g}$', '40 g', '70 g', '30 g', '65 g', '35 $\\\\\\\\mathrm{~g}$', '49 $\\\\\\\\mathrm{~g}$', '25 g', '60 $\\\\\\\\mathrm{~g}$']\",\"question\":\"A camper stranded in snowy weather loses heat by wind convection. The camper is packing emergency rations consisting of $58 \\\\%$ sucrose, $31 \\\\%$ fat, and $11 \\\\%$ protein by weight. Using the data provided in Problem P4.32 and assuming the fat content of the rations can be treated with palmitic acid data and the protein content similarly by the protein data in Problem P4.32, how much emergency rations must the camper consume in order to compensate for a reduction in body temperature of $3.5 \\\\mathrm{~K}$ ? Assume the heat capacity of the body equals that of water. Assume the camper weighs $67 \\\\mathrm{~kg}$.\",\"src\":\"scibench-thermo\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}