{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"704ba3bc-460b-55e0-9b83-7954e32c3272","task_key":"default--test--10470","task_revision_id":"1","upstream_id":"10470","short_description":"Explain the action of the following procedure which in-cludes asubroutine…","config":"default","split":"test","body":"{\"category\":\"computer science\",\"options\":\"['The subroutine procedure checks if each length value is between 0 and 100', 'The subroutine procedure returns the length value to the main program', 'The subroutine procedure is called only once in the program', 'The subroutine procedure is called at the beginning and end of the main program to validate the length', 'The subroutine procedure is called multiple times, each time incrementing the length value by 1', 'The subroutine procedure is called from three different points in the program, checks if each length value is between 0 and 90, and returns control to the main program.', 'The subroutine procedure is used to exit the main program if the length is within the specified range', 'The subroutine procedure is called recursively within itself to handle multiple length values', 'The subroutine procedure generates a list of length values from 0 to 90', 'The subroutine procedure is a loop that continues until the length value is outside the range of 0 to 90']\",\"question\":\"Explain the action of the following procedure which in-cludes asubroutine procedure within itself. VERIFY_TEST_VALUES: PROCEDURE; DCL LENGTH FIXEDDEC(3); CALL GET_AND_TEST_INPUT; \\\\textbullet \\\\textbullet \\\\textbullet \\\\textbullet \\\\textbullet CALL GET_AND_TEST_INPUT' \\\\textbullet \\\\textbullet \\\\textbullet \\\\textbullet \\\\textbullet GET_AND_TEST_INPUT:PROCEDURE; AGAIN:GETLIST(LENGTH); IF LENGTH = 0 THEN GOTO L; IF LENGTH<0 \\\\vert LENGTH>90 THEN DO; PUTLIST('ERROR', LENGTH);GOTOAGAIN; END; /\\\\textasteriskcentered END OF DO GROUP \\\\textasteriskcentered/ END GET_AND_TEST_INPUT; \\\\textbullet \\\\textbullet \\\\textbullet \\\\textbullet \\\\textbullet CALL GET_AND_TEST_INPUT; L:ENDVERIFY_TEST_VALUES;\",\"src\":\"stemez-ComputerScience\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}