{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"08fb8c28-adaf-5048-981a-b84875cf1b8d","task_key":"all--test--08fb8c28-adaf-5048-981a-b84875cf1b8d","task_revision_id":"1","upstream_id":"","short_description":"The code segment below uses the procedure IsFound (list, item), which returns…","config":"all","split":"test","body":"{\"choices\":\"['All elements in inputListl followed by all elements in inputList2', 'Only elements that appear in both inputListl and inputList2', 'Only elements that appear in either inputListl or inputList2 but not in both lists', 'Only elements that appear in inputListl but not in inputList2']\",\"question\":\"The code segment below uses the procedure IsFound (list, item), which returns true if item appears in list and returns false otherwise. The list resultList is initially empty.\\n  FOR EACH item IN inputList1{\\n IF (isFound (inputList2, item) )\\n APPEND (resultList, item)\\n }\\n Which of the following best describes the contents of resultList after the code segment is executed?\",\"subject\":\"high_school_computer_science\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}