{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3a1c736b-9668-5004-80ce-7291a9eb0246","task_key":"default--test--11485","task_revision_id":"1","upstream_id":"11485","short_description":"A frequency modulation (FM) receiver with input signal- to- noise ratio (S_i…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['β = 5, 58.7 dB; β = 10, 64.7 dB; β = 105, 85.185 dB', 'β = 5, 55.7 dB; β = 10, 61.7 dB; β = 105, 82.185 dB', 'β = 5, 50 dB; β = 10, 60 dB; β = 105, 80 dB', 'β = 5, 52.5 dB; β = 10, 58.5 dB; β = 105, 78.685 dB', 'β = 5, 60.1 dB; β = 10, 66.1 dB; β = 105, 87.285 dB', 'β = 5, 47.2 dB; β = 10, 53.2 dB; β = 105, 73.385 dB', 'β = 5, 45.7 dB; β = 10, 51.7 dB; β = 105, 72.185 dB', 'β = 5, 65.7 dB; β = 10, 71.7 dB; β = 105, 92.185 dB', 'β = 5, 43.6 dB; β = 10, 49.6 dB; β = 105, 69.785 dB', 'β = 5, 42 dB; β = 10, 48 dB; β = 105, 68.185 dB']\",\"question\":\"A frequency modulation (FM) receiver with input signal- to- noise ratio (S_i /nf_m) = 40 dB is used to pick- up sig-nals from different FM stations. If the transmitted FM signal is represented by km(t) = \\\\beta \\\\bullet \\\\omega \\\\bulletcos(\\\\omega_mt), calcu-late output signal- to- noise ratio for different values of \\\\beta such as 5, 10 and 105.\",\"src\":\"stemez-ElectronicCommunications\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}