{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2a326652-8027-5849-bbe5-78cd7f341c32","task_key":"all--test--2a326652-8027-5849-bbe5-78cd7f341c32","task_revision_id":"1","upstream_id":"","short_description":"Function signatures describe the types of the arguments to a function as well as…","config":"all","split":"test","body":"{\"choices\":\"['Currying can be applied to any function to the point where it has exactly one input argument.', 'Currying cannot be applied to functions of more than two arguments.', 'Currying cannot be applied to functions that return functions as arguments.', 'Currying cannot be applied w functions that haw arguments that are functions.']\",\"question\":\"Function signatures describe the types of the arguments to a function as well as the return value of the function. For instance, the addition function on reals has a signature of\\nadd : real x real -> real\\nsince it takes two real numbers and returns a real number. But, for a language that allows functions as return values, addition could be considered to have the signature\\nadd : real -> (real -> real)\\nwhich means that add takes a single real (the first operand) and returns a new function that itself takes a single real (the second operand) and returns a real (the result). This process of reducing a function with multiple arguments to a function with fewer arguments is called currying. Which of the following is correct?\",\"subject\":\"college_computer_science\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}