{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1ca82bd7-56ac-561a-955b-0eb9c4d24ff4","task_key":"default--test--11751","task_revision_id":"1","upstream_id":"11751","short_description":"Refrigerant 12 (Freon 12) at 20 psia and 30°F is compressed to 140 psia and…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['Work done during compression is -140 psia, heat removed during compression is -150 Btu/lb', 'Work done during compression is 11,670 ft-lb, heat removed during compression is 2.059 Btu/lb', 'Work done during compression is 11,670 ft-lb, heat removed during compression is -11,670 Btu/lb', 'Work done during compression is -11,670 ft-lb, heat removed during compression is -2.059 Btu/lb', 'Work done during compression is 140 psia, heat removed during compression is 30 Btu/lb', 'Work done during compression is -2.059 ft-lb, heat removed during compression is -11,670 Btu/lb', 'Work done during compression is -20 psia, heat removed during compression is 150 Btu/lb', 'Work done during compression is 20 ft-lb, heat removed during compression is -30 Btu/lb', 'Work done during compression is 2.059 ft-lb, heat removed during compression is 11,670 Btu/lb', 'Work done during compression is -11,670 ft-lb, heat removed during compression is 2.059 Btu/lb']\",\"question\":\"Refrigerant 12 (Freon 12) at 20 psia and 30°F is compressed to 140 psia and 150°F during a compression stroke. For a pound of this refrigerant (a) calculate the work done during compression, (b) the heat removed during compression.\",\"src\":\"stemez-Thermodynamics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}