{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d7f9ab90-cfd2-50ae-ae37-e1ad3ff21d3d","task_key":"default--test--11954","task_revision_id":"1","upstream_id":"11954","short_description":"An amplifier of power gain 20 db has an input consisting of 100\\muWsignal power…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['Output S/N ratio: 100, Noise factor: 2, Noise Figure: 3dB', 'Output S/N ratio: 50, Noise factor: 2, Noise Figure: 2dB', 'Output S/N ratio: 80, Noise factor: 2.5, Noise Figure: 4dB', 'Output S/N ratio: 20, Noise factor: 2, Noise Figure: 6dB', 'Output S/N ratio: 25, Noise factor: 4, Noise Figure: 6dB', 'Output S/N ratio: 50, Noise factor: 1, Noise Figure: 3dB', 'Output S/N ratio: 50, Noise factor: 1.5, Noise Figure: 1.76dB', 'Output S/N ratio: 40, Noise factor: 3, Noise Figure: 4.77dB', 'Output S/N ratio: 100, Noise factor: 1, Noise Figure: 0dB', 'Output S/N ratio: 50, Noise factor: 2, Noise Figure: 3dB']\",\"question\":\"An amplifier of power gain 20 db has an input consisting of 100\\\\muWsignal power and 1\\\\muWnoise power.If the amplifier contributesan additional 100\\\\muWof noise, determine (a)theoutput signal to noise ratio, (b)thenoise factor and (c)thenoise figure.\",\"src\":\"stemez-ElectronicCommunications\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}