{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a395ce24-43f7-5e6b-ad16-60cd232fcac4","task_key":"default--test--11401","task_revision_id":"1","upstream_id":"11401","short_description":"For sea water with \\gamma = 5 mhos/meter and\\epsilon_r= 80, find the distance a…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['4.5 meters for 25kcps and 15 cm for 25mcps', '5 meters for 25mcps and 20 cm for 25kcps', '1 meter for 25kcps and 30 cm for 25mcps', '3.22 meters for both 25kcps and 25mcps', '2.3 meters for 25kcps and 10 cm for 25mcps', '3.22 meters for 25mcps and 10 cm for 25kcps', '2.5 meters for 25mcps and 5 cm for 25kcps', '3.22 meters for 25kcps and 10 cm for 25mcps', '3.22 cm for 25kcps and 10 meters for 25mcps', '10 cm for both 25kcps and 25mcps']\",\"question\":\"For sea water with \\\\gamma = 5 mhos/meter and\\\\epsilon_r= 80, find the distance a radio signal can be transmitted at 25kcps and 25mcps, if the range is taken to be the distance at which 90 per cent of the wave amplitude is attenuated.\",\"src\":\"stemez-Electromagnetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}