{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e7ab21c1-a9c6-5b22-8bda-cbf44b437e03","task_key":"all--test--e7ab21c1-a9c6-5b22-8bda-cbf44b437e03","task_revision_id":"1","upstream_id":"","short_description":"Suppose sharing of tiles in a multilevel directory structure is achieved with…","config":"all","split":"test","body":"{\"choices\":\"['If the owner modifies the file, another user who does not share will see the changes.', 'If the owner renames the file, other users will not be able to access it.', 'If the owner is allowed to delete a file, dangling links may result.', 'If any user who shares the file appends to it, others who share it will not be able to access the new disk blocks.']\",\"question\":\"Suppose sharing of tiles in a multilevel directory structure is achieved with directory entries that are links pointing to a node containing information about a shared file. Information in this node includes (1) the owner of the file, (2) a count of the number of links to the tile, and (3) the disk block numbers of the file. What is a primary drawback to this approach to sharing?\",\"subject\":\"college_computer_science\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}