{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ef9943c0-99ac-5cdb-a604-b732bef69c0e","task_key":"all--test--ef9943c0-99ac-5cdb-a604-b732bef69c0e","task_revision_id":"1","upstream_id":"","short_description":"Assume that any assignment statement can be executed in unit time. If as many…","config":"all","split":"test","body":"{\"choices\":\"['1', '2', '3', '4']\",\"question\":\"Assume that any assignment statement can be executed in unit time. If as many identical processors as needed are used, what is the minimum number of time units needed to execute the assignments\\nA := B + C\\nB := A - B\\nC := A * E\\nD := A/F\\nE := B - C\\nF := A + B\\nwith the same result as if the assignments were executed in the order shown?\",\"subject\":\"college_computer_science\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}