{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8e06e35e-9eb2-5cab-a9fd-3c40ec12fbbd","task_key":"default--test--10379","task_revision_id":"1","upstream_id":"10379","short_description":"Describe in words the function and the output of the following subroutine.…","config":"default","split":"test","body":"{\"category\":\"computer science\",\"options\":\"['The program finds the greatest common divisor K of two positive integers I and J.', 'The program calculates the least common multiple of I and J.', 'The program calculates the arithmetic mean of I and J and stores the result in K.', 'The program determines if I is a multiple of J and stores the boolean result in K.', 'The program adds I and J and stores the result in K.', 'The program finds the least common multiple of I and J and assigns it to K.', 'The program multiplies I and J and assigns the product to K.', 'The program subtracts J from I and stores the result in K.', 'The program generates a random number between I and J and assigns it to K.', 'The program computes the sum of all integers between I and J and assigns it to K.']\",\"question\":\"Describe in words the function and the output of the following subroutine. SUBROUTINE GCD (I,J,K) IF (I - J) 1,4,2 1 L = J J = I I = L 2L = I-(I/J){_\\\\ast}J IF(L) 3,4,3 3 I = J J = L GO TO 2 4 K = J RETURN END\",\"src\":\"stemez-ComputerScience\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}