{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"humaneval","formal_name":"HumanEval","introduction":"HumanEval asks for a Python function body from a docstring and signature, checked by hidden unit tests. It is the original functional-correctness benchmark for code generation.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/openai/openai_humaneval","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"9086b326-04cd-54fa-8d56-e0be06788aa0","task_key":"openai~5fhumaneval--test--9086b326-04cd-54fa-8d56-e0be06788aa0","task_revision_id":"1","upstream_id":"","short_description":"def match_parens(lst):","config":"openai_humaneval","split":"test","body":"{\"entry_point\":\"match_parens\",\"prompt\":\"\\ndef match_parens(lst):\\n    '''\\n    You are given a list of two strings, both strings consist of open\\n    parentheses '(' or close parentheses ')' only.\\n    Your job is to check if it is possible to concatenate the two strings in\\n    some order, that the resulting string will be good.\\n    A string S is considered to be good if and only if all parentheses in S\\n    are balanced. For example: the string '(())()' is good, while the string\\n    '())' is not.\\n    Return 'Yes' if there's a way to make a good string, and return 'No' otherwise.\\n\\n    Examples:\\n    match_parens(['()(', ')']) == 'Yes'\\n    match_parens([')', ')']) == 'No'\\n    '''\\n\"}","display_format":"text","language":"","answer_status":"unknown","assets":[],"source_url":"https://huggingface.co/datasets/openai/openai_humaneval","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}