{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"64424014-4187-511b-b660-116cb94b35a7","task_key":"default--test--10703","task_revision_id":"1","upstream_id":"10703","short_description":"If we have a list of tabular values represented by a one-dimensionalar-ray, then…","config":"default","split":"test","body":"{\"category\":\"computer science\",\"options\":\"['DIMENSIONX(50), DX(49) DO 50 I = 1, 50 50DX(I) = X(I + 1) - X(I) STOP END', 'DIMENSION X(50) DIMENSION DX(50) DO 50 I = 1, 49 50 DX(I) = X(I + 2) - X(I) STOP END', 'DIMENSION X(50), DX(48) DO 50 I = 1, 48 50 DX(I) = X(I + 1) - X(I) STOP END', 'DIMENSION X(50), DX(49) FOR I = 1 TO 49 DX(I) = X(I) - X(I + 1) NEXT I STOP END', 'DIMENSIONX(50), DX(49) DO 50 I = 1, 49 50DX(I) = X(I + 1) - X(I) STOP END', 'DIMENSIONX(50), DX(50) DO 50 I = 1, 49 50DX(I) = X(I) - X(I+1) STOP END', 'DIMENSION X(50), DX(49) DO 50 I = 2, 50 50 DX(I-1) = X(I) - X(I - 1) STOP END', 'DIMENSIONX(49), DX(50) DO 50 I = 1, 49 50DX(I) = X(I + 1) - X(I) STOP END', 'DIMENSION X(51), DX(49) DO 50 I = 1, 49 50 DX(I) = X(I + 1) - X(I) STOP END', 'DIMENSION X(50), DX(49) DO 50 I = 1, 48 50 DX(I) = X(I + 2) - X(I + 1) STOP END']\",\"question\":\"If we have a list of tabular values represented by a one-dimensionalar-ray, then the first differences of the list areformed by subtracting each element except the last [sincenothing follows the last element] from the element immediatelyfollowing it. Suppose we have a one--dimensionalarray named X that contains 50 elements. Compute the 49 elements of another array named DX from DX(I) = X(I + 1) - X(I) I = 1,2,...,49. Write a program segment to perform this calculation.\",\"src\":\"stemez-ComputerScience\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}