{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b89b114c-5e29-5538-a9ee-b3674ac2a7a4","task_key":"default--test--11807","task_revision_id":"1","upstream_id":"11807","short_description":"A vertical pipe 60 mm. internal diameter and 1.6 m long has 0.2 mm. thick water…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['0.9333 kg/hr', '0.3810 m/sec', '0.6222 kg/hr', '55.41 k mole/m^3', '0.0783 k mole/hr', '0.3111 kg/hr', '0.0366 k mole/hr', '0.1905 m/sec', '1.245 kg/hr', '110.82 k mole/m^3']\",\"question\":\"A vertical pipe 60 mm. internal diameter and 1.6 m long has 0.2 mm. thick water film at 293°K running down on the inside wall and air stream containing ammonia is flowing through the pipe. The interfacial mole fraction of ammonia is 0.0372. If the water at inlet is pure, determine the mass rate of removal of ammonia from the air stream.\",\"src\":\"stemez-TransportPhenomena\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}