{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"humaneval","formal_name":"HumanEval","introduction":"HumanEval asks for a Python function body from a docstring and signature, checked by hidden unit tests. It is the original functional-correctness benchmark for code generation.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/openai/openai_humaneval","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"3a023f4d-1ee1-551e-8ced-bd3ea6d829ff","task_key":"openai~5fhumaneval--test--3a023f4d-1ee1-551e-8ced-bd3ea6d829ff","task_revision_id":"1","upstream_id":"","short_description":"def hex_key(num):","config":"openai_humaneval","split":"test","body":"{\"entry_point\":\"hex_key\",\"prompt\":\"\\ndef hex_key(num):\\n    \\\"\\\"\\\"You have been tasked to write a function that receives \\n    a hexadecimal number as a string and counts the number of hexadecimal \\n    digits that are primes (prime number, or a prime, is a natural number \\n    greater than 1 that is not a product of two smaller natural numbers).\\n    Hexadecimal digits are 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, A, B, C, D, E, F.\\n    Prime numbers are 2, 3, 5, 7, 11, 13, 17,...\\n    So you have to determine a number of the following digits: 2, 3, 5, 7, \\n    B (=decimal 11), D (=decimal 13).\\n    Note: you may assume the input is always correct or empty string, \\n    and symbols A,B,C,D,E,F are always uppercase.\\n    Examples:\\n    For num = \\\"AB\\\" the output should be 1.\\n    For num = \\\"1077E\\\" the output should be 2.\\n    For num = \\\"ABED1A33\\\" the output should be 4.\\n    For num = \\\"123456789ABCDEF0\\\" the output should be 6.\\n    For num = \\\"2020\\\" the output should be 2.\\n    \\\"\\\"\\\"\\n\"}","display_format":"text","language":"","answer_status":"unknown","assets":[],"source_url":"https://huggingface.co/datasets/openai/openai_humaneval","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}