{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"humaneval-plus","formal_name":"HumanEval+","introduction":"HumanEval+ keeps the 164 original HumanEval problems and multiplies their tests by roughly 80×. It exists because the original suite was loose enough to pass implementations that were actually wrong.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/evalplus/evalplus","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"d1f75965-15f2-5ca5-a9e0-c26fc14a627c","task_key":"default--test--d1f75965-15f2-5ca5-a9e0-c26fc14a627c","task_revision_id":"2","upstream_id":"","short_description":"def hex_key(num):","config":"default","split":"test","body":"{\"entry_point\":\"hex_key\",\"prompt\":\"\\ndef hex_key(num):\\n    \\\"\\\"\\\"You have been tasked to write a function that receives \\n    a hexadecimal number as a string and counts the number of hexadecimal \\n    digits that are primes (prime number, or a prime, is a natural number \\n    greater than 1 that is not a product of two smaller natural numbers).\\n    Hexadecimal digits are 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, A, B, C, D, E, F.\\n    Prime numbers are 2, 3, 5, 7, 11, 13, 17,...\\n    So you have to determine a number of the following digits: 2, 3, 5, 7, \\n    B (=decimal 11), D (=decimal 13).\\n    Note: you may assume the input is always correct or empty string, \\n    and symbols A,B,C,D,E,F are always uppercase.\\n    Examples:\\n    For num = \\\"AB\\\" the output should be 1.\\n    For num = \\\"1077E\\\" the output should be 2.\\n    For num = \\\"ABED1A33\\\" the output should be 4.\\n    For num = \\\"123456789ABCDEF0\\\" the output should be 6.\\n    For num = \\\"2020\\\" the output should be 2.\\n    \\\"\\\"\\\"\\n\"}","display_format":"code","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/evalplus/evalplus","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}