{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"humaneval","formal_name":"HumanEval","introduction":"HumanEval asks for a Python function body from a docstring and signature, checked by hidden unit tests. It is the original functional-correctness benchmark for code generation.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/openai/openai_humaneval","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"6d49dfcb-a20d-57bb-bf94-943a65727a2a","task_key":"openai~5fhumaneval--test--6d49dfcb-a20d-57bb-bf94-943a65727a2a","task_revision_id":"1","upstream_id":"","short_description":"def Strongest_Extension(class_name, extensions):","config":"openai_humaneval","split":"test","body":"{\"entry_point\":\"Strongest_Extension\",\"prompt\":\"\\ndef Strongest_Extension(class_name, extensions):\\n    \\\"\\\"\\\"You will be given the name of a class (a string) and a list of extensions.\\n    The extensions are to be used to load additional classes to the class. The\\n    strength of the extension is as follows: Let CAP be the number of the uppercase\\n    letters in the extension's name, and let SM be the number of lowercase letters \\n    in the extension's name, the strength is given by the fraction CAP - SM. \\n    You should find the strongest extension and return a string in this \\n    format: ClassName.StrongestExtensionName.\\n    If there are two or more extensions with the same strength, you should\\n    choose the one that comes first in the list.\\n    For example, if you are given \\\"Slices\\\" as the class and a list of the\\n    extensions: ['SErviNGSliCes', 'Cheese', 'StuFfed'] then you should\\n    return 'Slices.SErviNGSliCes' since 'SErviNGSliCes' is the strongest extension \\n    (its strength is -1).\\n    Example:\\n    for Strongest_Extension('my_class', ['AA', 'Be', 'CC']) == 'my_class.AA'\\n    \\\"\\\"\\\"\\n\"}","display_format":"text","language":"","answer_status":"unknown","assets":[],"source_url":"https://huggingface.co/datasets/openai/openai_humaneval","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}