{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"humaneval","formal_name":"HumanEval","introduction":"HumanEval asks for a Python function body from a docstring and signature, checked by hidden unit tests. It is the original functional-correctness benchmark for code generation.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/openai/openai_humaneval","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"87ade5e0-d3c6-5952-ade4-80b5b19e8faf","task_key":"openai~5fhumaneval--test--87ade5e0-d3c6-5952-ade4-80b5b19e8faf","task_revision_id":"1","upstream_id":"","short_description":"def simplify(x, n):","config":"openai_humaneval","split":"test","body":"{\"entry_point\":\"simplify\",\"prompt\":\"\\ndef simplify(x, n):\\n    \\\"\\\"\\\"Your task is to implement a function that will simplify the expression\\n    x * n. The function returns True if x * n evaluates to a whole number and False\\n    otherwise. Both x and n, are string representation of a fraction, and have the following format,\\n    <numerator>/<denominator> where both numerator and denominator are positive whole numbers.\\n\\n    You can assume that x, and n are valid fractions, and do not have zero as denominator.\\n\\n    simplify(\\\"1/5\\\", \\\"5/1\\\") = True\\n    simplify(\\\"1/6\\\", \\\"2/1\\\") = False\\n    simplify(\\\"7/10\\\", \\\"10/2\\\") = False\\n    \\\"\\\"\\\"\\n\"}","display_format":"text","language":"","answer_status":"unknown","assets":[],"source_url":"https://huggingface.co/datasets/openai/openai_humaneval","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}