{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"humaneval","formal_name":"HumanEval","introduction":"HumanEval asks for a Python function body from a docstring and signature, checked by hidden unit tests. It is the original functional-correctness benchmark for code generation.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/openai/openai_humaneval","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"bb807e74-aa69-57ca-bb2d-26781def45e4","task_key":"openai~5fhumaneval--test--bb807e74-aa69-57ca-bb2d-26781def45e4","task_revision_id":"1","upstream_id":"","short_description":"def eat(number, need, remaining):","config":"openai_humaneval","split":"test","body":"{\"entry_point\":\"eat\",\"prompt\":\"\\ndef eat(number, need, remaining):\\n    \\\"\\\"\\\"\\n    You're a hungry rabbit, and you already have eaten a certain number of carrots,\\n    but now you need to eat more carrots to complete the day's meals.\\n    you should return an array of [ total number of eaten carrots after your meals,\\n                                    the number of carrots left after your meals ]\\n    if there are not enough remaining carrots, you will eat all remaining carrots, but will still be hungry.\\n    \\n    Example:\\n    * eat(5, 6, 10) -> [11, 4]\\n    * eat(4, 8, 9) -> [12, 1]\\n    * eat(1, 10, 10) -> [11, 0]\\n    * eat(2, 11, 5) -> [7, 0]\\n    \\n    Variables:\\n    @number : integer\\n        the number of carrots that you have eaten.\\n    @need : integer\\n        the number of carrots that you need to eat.\\n    @remaining : integer\\n        the number of remaining carrots thet exist in stock\\n    \\n    Constrain:\\n    * 0 <= number <= 1000\\n    * 0 <= need <= 1000\\n    * 0 <= remaining <= 1000\\n\\n    Have fun :)\\n    \\\"\\\"\\\"\\n\"}","display_format":"text","language":"","answer_status":"unknown","assets":[],"source_url":"https://huggingface.co/datasets/openai/openai_humaneval","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}