{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c2b4916a-62fb-5eff-bae2-68f6b65d1de1","task_key":"default--test--10677","task_revision_id":"1","upstream_id":"10677","short_description":"What is wrong in the following array declaration? int my _ array (200);","config":"default","split":"test","body":"{\"category\":\"computer science\",\"options\":\"['The datatype for the array elements is not specified', 'The array is not initialized', 'The array size is too large', 'The semicolon is missing at the end of the declaration', 'The array size should be a constant expression', 'The array size must be defined after the variable name', 'The number of subscripts is not enclosed in square brackets']\",\"question\":\"What is wrong in the following array declaration? int my _ array (200);\",\"src\":\"stemez-ComputerScience\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}