{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"humaneval","formal_name":"HumanEval","introduction":"HumanEval asks for a Python function body from a docstring and signature, checked by hidden unit tests. It is the original functional-correctness benchmark for code generation.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/openai/openai_humaneval","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"1d14489e-e303-5bf0-a45d-2fea323706d2","task_key":"openai~5fhumaneval--test--1d14489e-e303-5bf0-a45d-2fea323706d2","task_revision_id":"1","upstream_id":"","short_description":"import math","config":"openai_humaneval","split":"test","body":"{\"entry_point\":\"find_zero\",\"prompt\":\"import math\\n\\n\\ndef poly(xs: list, x: float):\\n    \\\"\\\"\\\"\\n    Evaluates polynomial with coefficients xs at point x.\\n    return xs[0] + xs[1] * x + xs[1] * x^2 + .... xs[n] * x^n\\n    \\\"\\\"\\\"\\n    return sum([coeff * math.pow(x, i) for i, coeff in enumerate(xs)])\\n\\n\\ndef find_zero(xs: list):\\n    \\\"\\\"\\\" xs are coefficients of a polynomial.\\n    find_zero find x such that poly(x) = 0.\\n    find_zero returns only only zero point, even if there are many.\\n    Moreover, find_zero only takes list xs having even number of coefficients\\n    and largest non zero coefficient as it guarantees\\n    a solution.\\n    >>> round(find_zero([1, 2]), 2) # f(x) = 1 + 2x\\n    -0.5\\n    >>> round(find_zero([-6, 11, -6, 1]), 2) # (x - 1) * (x - 2) * (x - 3) = -6 + 11x - 6x^2 + x^3\\n    1.0\\n    \\\"\\\"\\\"\\n\"}","display_format":"text","language":"","answer_status":"unknown","assets":[],"source_url":"https://huggingface.co/datasets/openai/openai_humaneval","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}