{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f6a42433-6063-5e39-b8e0-639e96574b92","task_key":"default--test--9384","task_revision_id":"1","upstream_id":"9384","short_description":"What is the impedance of a 1-henry inductor at angular frequencies of 100, 1000…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['500 ohms, 5000 ohms, 50 ohms', '100 ohms, 1000 ohms, 10,000 ohms', '600 ohms, 6000 ohms, 60 ohms', '2000 ohms, 20000 ohms, 200 ohms', '700 ohms, 7000 ohms, 70 ohms', '400 ohms, 4000 ohms, 40 ohms', '800 ohms, 8000 ohms, 80 ohms', '1000 ohms, 10000 ohms, 100 ohms', '300 ohms, 3000 ohms, 30 ohms', '1500 ohms, 15000 ohms, 150 ohms']\",\"question\":\"What is the impedance of a 1-henry inductor at angular frequencies of 100, 1000 and 10,000rad/sec?\",\"src\":\"stemez-Physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}