{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4688bc53-d429-50f4-9a96-0bc6705deab3","task_key":"all--test--4688bc53-d429-50f4-9a96-0bc6705deab3","task_revision_id":"1","upstream_id":"","short_description":"Consider a computer system in which processes can request and release one or…","config":"all","split":"test","body":"{\"choices\":\"['Giving priorities to processes and ordering the wait queues by priority', 'Having a process request all its required resources when it first begins, and restarting if it cannot obtain them all', 'Numbering the resources and requiring that processes request resources in order of increasing number', 'Having processes time out and restart after a random interval of waiting']\",\"question\":\"Consider a computer system in which processes can request and release one or more resources. Once a process has been granted a resource, the process has exclusive use of that resource until it is released. If a process requests a resource that is already in use, the process enters a queue for that resource, waiting until the resource is available. Which of the following will NOT deal effectively with the problem of deadlock?\",\"subject\":\"college_computer_science\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}