{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"267b712e-261c-59f9-8052-9c11198b2f67","task_key":"default--test--11661","task_revision_id":"1","upstream_id":"11661","short_description":"A container with an air tight piston is at a pressure of 100psiaand a…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['Change in internal energy: 80 Btu, Final temperature: 2000°F, Heat capacity: 0.20 Btu/°R', 'Change in internal energy: 95 Btu, Final temperature: 1650°F, Heat capacity: 0.18 Btu/°R', 'Change in internal energy: 60 Btu, Final temperature: 1550°F, Heat capacity: 0.15 Btu/°R', 'Change in internal energy: 25 Btu, Final temperature: 1500°F, Heat capacity: 0.08 Btu/°R', 'Change in internal energy: 72.2 Btu, Final temperature: 1660°F, Heat capacity: 0.0629 Btu/°R', 'Change in internal energy: 110 Btu, Final temperature: 1900°F, Heat capacity: 0.30 Btu/°R', 'Change in internal energy: 50 Btu, Final temperature: 1800°F, Heat capacity: 0.10 Btu/°R', 'Change in internal energy: 100 Btu, Final temperature: 2120°F, Heat capacity: 0.50 Btu/°R', 'Change in internal energy: 90 Btu, Final temperature: 1750°F, Heat capacity: 0.25 Btu/°R', 'Change in internal energy: 40 Btu, Final temperature: 1400°F, Heat capacity: 0.12 Btu/°R']\",\"question\":\"A container with an air tight piston is at a pressure of 100psiaand a temperature of 70°F. The piston moves up when 100 Btu of heat is transferred and the volume changes from 0.5 ft^3 to 2.0 ft^3. Assuming perfect gas behavior, calculate a) the change in internal energy, b) the final temperature and c) the heat capacity of the process.\",\"src\":\"stemez-Thermodynamics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}