{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"humaneval","formal_name":"HumanEval","introduction":"HumanEval asks for a Python function body from a docstring and signature, checked by hidden unit tests. It is the original functional-correctness benchmark for code generation.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/openai/openai_humaneval","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"3bbee3c0-30b9-504c-b1d7-fa8c4a6600bd","task_key":"openai~5fhumaneval--test--3bbee3c0-30b9-504c-b1d7-fa8c4a6600bd","task_revision_id":"1","upstream_id":"","short_description":"def numerical_letter_grade(grades):","config":"openai_humaneval","split":"test","body":"{\"entry_point\":\"numerical_letter_grade\",\"prompt\":\"\\ndef numerical_letter_grade(grades):\\n    \\\"\\\"\\\"It is the last week of the semester and the teacher has to give the grades\\n    to students. The teacher has been making her own algorithm for grading.\\n    The only problem is, she has lost the code she used for grading.\\n    She has given you a list of GPAs for some students and you have to write \\n    a function that can output a list of letter grades using the following table:\\n             GPA       |    Letter grade\\n              4.0                A+\\n            > 3.7                A \\n            > 3.3                A- \\n            > 3.0                B+\\n            > 2.7                B \\n            > 2.3                B-\\n            > 2.0                C+\\n            > 1.7                C\\n            > 1.3                C-\\n            > 1.0                D+ \\n            > 0.7                D \\n            > 0.0                D-\\n              0.0                E\\n    \\n\\n    Example:\\n    grade_equation([4.0, 3, 1.7, 2, 3.5]) ==> ['A+', 'B', 'C-', 'C', 'A-']\\n    \\\"\\\"\\\"\\n\"}","display_format":"text","language":"","answer_status":"unknown","assets":[],"source_url":"https://huggingface.co/datasets/openai/openai_humaneval","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}