{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"226b6e41-0a8e-52d9-a526-27a0a0af332c","task_key":"default--test--12113","task_revision_id":"1","upstream_id":"12113","short_description":"A rectangular section of a porous solid 0.5 in. thick is submergedin 100 %…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['1.00 min', '4.00 min', '0.10 min', '0.50 min', '3.00 min', '0.75 min', '0.126 min', '0.25 min', '2.00 min', '1.50 min']\",\"question\":\"A rectangular section of a porous solid 0.5 in. thick is submergedin 100 % ethanol. The voids of the solid compose50 % of its volume. The solid is removed from the ethanolafter thorough soaking and placed in an agitated tankof water at 80°F. Only molecular diffusion occurs in the pores, and the diffusivity inside the pores is approximately onetenth of its value outside the solid. What length of timeis requiredfor the mass fraction of ethanol at the center of the solidto drop to 0.008? Assume the concentration of ethanol inthe water phase is always zero.\",\"src\":\"stemez-TransportPhenomena\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}