{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dc53bc69-c25d-5a3c-9d83-53c1ad10cd20","task_key":"default--test--9382","task_revision_id":"1","upstream_id":"9382","short_description":"What is the impedance of a 1-\\muf capacitor at angular frequencies of 100, 1000…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['100 ohms, 1000 ohms, 1000 ohms', '159.15 ohms, 1591.5 ohms, 15915 ohms', '1000 ohms, 100 ohms, 10,000 ohms', '10 ohms, 100 ohms, 1000 ohms', '3183 ohms, 318.3 ohms, 31.83 ohms', '15915 ohms, 1591.5 ohms, 159.15 ohms', '1000 ohms, 10 ohms, 100 ohms', '100 ohms, 10,000 ohms, 1000 ohms', '100 ohms, 1000 ohms, 10,000 ohms', '10,000 ohms, 1000 ohms, 100 ohms']\",\"question\":\"What is the impedance of a 1-\\\\muf capacitor at angular frequencies of 100, 1000 and 10,000rad/sec?\",\"src\":\"stemez-Physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}