{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3c4c150a-45cd-5198-abe3-3aedd6a681c9","task_key":"default--test--10568","task_revision_id":"1","upstream_id":"10568","short_description":"Can a stream cipher have perfect secrecy?","config":"default","split":"test","body":"{\"category\":\"computer science\",\"options\":\"['Yes, if the PRG is really “secure”', 'No, because perfect secrecy is not possible in any cipher', 'Yes, if the stream cipher is implemented correctly', 'No, since the key is shorter than the message', 'Yes, every cipher has perfect secrecy', 'Yes, if the key is longer than the message', 'No, only block ciphers can have perfect secrecy', 'Yes, if the key is used only once', 'No, since the key is reused for the stream cipher', 'No, there are no ciphers with perfect secrecy']\",\"question\":\"Can a stream cipher have perfect secrecy?\",\"src\":\"ori_mmlu-computer_security\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}