{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"24351d34-df0b-5691-913b-e1d606f96ae9","task_key":"all--test--24351d34-df0b-5691-913b-e1d606f96ae9","task_revision_id":"1","upstream_id":"","short_description":"Which of the following considerations applies (apply) to choosing the page size…","config":"all","split":"test","body":"{\"choices\":\"['I only', 'II only', 'I and III only', 'I, II, and III']\",\"question\":\"Which of the following considerations applies (apply) to choosing the page size in a paging system?\\nI. An advantage of larger pages is that they lead to smaller page tables.\\nII. An advantage of smaller pages is that they lead to less waste due to internal fragmentation.\\nIII. Normally, the dominant factor in disk access time is not dependent on page length, so longer pages can be used advantageously.\",\"subject\":\"college_computer_science\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}