{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d2c408b7-df0c-51bf-8870-73d357adea9d","task_key":"default--test--11980","task_revision_id":"1","upstream_id":"11980","short_description":"An ideal gas is enclosed inside a chamber with a volume of 0.1 ft^3 at 115°C,…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['2.3456 kJ', '3.2109 kJ', '2.0000 kJ', '1.5678 kJ', '1.4567 kJ', '2.6789 kJ', '2.1234 kJ', '1.8122 kJ', '1.2345 kJ', '0.9876 kJ']\",\"question\":\"An ideal gas is enclosed inside a chamber with a volume of 0.1 ft^3 at 115°C, 690kPa. It then expandsisentropicallyto a final pressure of 138kPa. Calculate the work done during the process, assuming that for this gas c_v= 0.7201 kJ/kg-°K c_p = 1.0048 kJ/kg-°K\",\"src\":\"stemez-Thermodynamics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}