{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0c53f0e2-467c-52cd-b996-303a659c82dd","task_key":"default--test--11699","task_revision_id":"1","upstream_id":"11699","short_description":"At 9 GHz the inside dimensions of the standard waveguide usedin practice are 0.9…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['1.2 × 10^6 W', '0.65 × 10^6 W', '1.05 × 10^6 W', '0.5 × 10^6 W', '1.0 × 10^6 W', '0.944 × 10^6 W', '0.85 × 10^6 W', '1.5 × 10^6 W', '1.75 × 10^6 W', '2.0 × 10^6 W']\",\"question\":\"At 9 GHz the inside dimensions of the standard waveguide usedin practice are 0.9 by 0.4 in. Find the maximum power thatcan be transmitted in the TE mode, assuming that the airdielectric will break down when the electric field intensity exceeds3 × 10 (V/m).\",\"src\":\"stemez-Electromagnetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}