{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5d184943-7bbf-5688-8cbb-230a5f0d0255","task_key":"default--test--10624","task_revision_id":"1","upstream_id":"10624","short_description":"Function signatures describe the types of the arguments to a function as well as…","config":"default","split":"test","body":"{\"category\":\"computer science\",\"options\":\"['Currying can be applied to any function to the point where it has exactly one input argument.', 'Currying cannot be applied to functions of more than two arguments.', 'Currying cannot be applied to functions that return functions as arguments.', 'Currying cannot be applied w functions that haw arguments that are functions.']\",\"question\":\"Function signatures describe the types of the arguments to a function as well as the return value of the function. For instance, the addition function on reals has a signature of\\nadd : real x real -> real\\nsince it takes two real numbers and returns a real number. But, for a language that allows functions as return values, addition could be considered to have the signature\\nadd : real -> (real -> real)\\nwhich means that add takes a single real (the first operand) and returns a new function that itself takes a single real (the second operand) and returns a real (the result). This process of reducing a function with multiple arguments to a function with fewer arguments is called currying. Which of the following is correct?\",\"src\":\"ori_mmlu-college_computer_science\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}