{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"humaneval-plus","formal_name":"HumanEval+","introduction":"HumanEval+ keeps the 164 original HumanEval problems and multiplies their tests by roughly 80×. It exists because the original suite was loose enough to pass implementations that were actually wrong.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/evalplus/evalplus","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"b74cd3f1-d935-5e02-af86-c80e240f9fee","task_key":"default--test--b74cd3f1-d935-5e02-af86-c80e240f9fee","task_revision_id":"2","upstream_id":"","short_description":"def bf(planet1, planet2):","config":"default","split":"test","body":"{\"entry_point\":\"bf\",\"prompt\":\"\\ndef bf(planet1, planet2):\\n    '''\\n    There are eight planets in our solar system: the closerst to the Sun \\n    is Mercury, the next one is Venus, then Earth, Mars, Jupiter, Saturn, \\n    Uranus, Neptune.\\n    Write a function that takes two planet names as strings planet1 and planet2. \\n    The function should return a tuple containing all planets whose orbits are \\n    located between the orbit of planet1 and the orbit of planet2, sorted by \\n    the proximity to the sun. \\n    The function should return an empty tuple if planet1 or planet2\\n    are not correct planet names. \\n    Examples\\n    bf(\\\"Jupiter\\\", \\\"Neptune\\\") ==> (\\\"Saturn\\\", \\\"Uranus\\\")\\n    bf(\\\"Earth\\\", \\\"Mercury\\\") ==> (\\\"Venus\\\")\\n    bf(\\\"Mercury\\\", \\\"Uranus\\\") ==> (\\\"Venus\\\", \\\"Earth\\\", \\\"Mars\\\", \\\"Jupiter\\\", \\\"Saturn\\\")\\n    '''\\n\"}","display_format":"code","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/evalplus/evalplus","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}