{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"47e26bb7-0cce-5ae7-a788-24d15465d82a","task_key":"default--test--12248","task_revision_id":"1","upstream_id":"12248","short_description":"Water at 340°K and a rate of 4 Kg/hr is required for a certain process. Water,…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['Length of piping required is 2m and the maximum temperature at the exit is 360K', 'Length of piping required is 1.48m and the maximum temperature at the exit is 354.8K', 'Length of piping required is 1m and the maximum temperature at the exit is 345K', 'Length of piping required is 2.1m and the maximum temperature at the exit is 353K', 'Length of piping required is 2.8m and the maximum temperature at the exit is 358K', 'Length of piping required is 3m and the maximum temperature at the exit is 355K', 'Length of piping required is 1.5m and the maximum temperature at the exit is 350K', 'Length of piping required is 2.2m and the maximum temperature at the exit is 370K', 'Length of piping required is 2.5m and the maximum temperature at the exit is 365K', 'Length of piping required is 1.75m and the maximum temperature at the exit is 360K']\",\"question\":\"Water at 340°K and a rate of 4 Kg/hr is required for a certain process. Water, available at 300°K, is to be heated as it passes through a 7mm ID pipe which provides 125 W per meter length of pipe. Determine the length of piping required and the maximum temperature at the exit.\",\"src\":\"stemez-TransportPhenomena\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}