{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1792741b-654c-506d-a4e0-b181625cc720","task_key":"all--test--1792741b-654c-506d-a4e0-b181625cc720","task_revision_id":"1","upstream_id":"","short_description":"Consider the following assumptions about electronic storage for the text in all…","config":"all","split":"test","body":"{\"choices\":\"['Megabyte ( 2^20 or approximately 10^6 bytes)', 'Gigabyte ( 2^30 or approximately 10^9 bytes)', 'Terabyte ( 2^40 or approximately 10^12 bytes)', 'Petabyte ( 2^50 or approximately 10^15 bytes)']\",\"question\":\"Consider the following assumptions about electronic storage for the text in all the books of a university's libraries. - The libraries at the university collectively contain 3 million books. - A book contains an average of 400 pages. - A page contains an average of 50 lines. - A line on a page contains an average of 10 words. - A word contains an average of 5 letters/characters. - A letter/character is represented by 1 byte. Based on the given assumptions, which of the following is the unit in which the electronic storage required for the text in all the books of the university's libraries would best be measured?\",\"subject\":\"high_school_computer_science\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}