{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bigcodebench","formal_name":"BigCodeBench","introduction":"BigCodeBench poses 1,140 function-level tasks drawn across 139 libraries. It tests whether a model can compose several real APIs correctly rather than write one self-contained function.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://bigcode-bench.github.io/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b64e405f-f8f2-50e5-b54b-aaf688f1a95f","task_key":"default--v0~2e1~2e0~5fhf--b64e405f-f8f2-50e5-b54b-aaf688f1a95f","task_revision_id":"1","upstream_id":"","short_description":"BigCodeBench v0.1.0_hf b64e405f-f8f2-50e5-b54b-aaf688f1a95f","config":"default","split":"v0.1.0_hf","body":"{\"code_prompt\":\"import random\\nimport string\\n# Constants\\nLETTERS = string.ascii_letters\\nDIGITS = string.digits\\ndef task_func(length, num_digits):\\n\",\"complete_prompt\":\"import random\\nimport string\\n\\n# Constants\\nLETTERS = string.ascii_letters\\nDIGITS = string.digits\\n\\ndef task_func(length, num_digits):\\n    \\\"\\\"\\\"\\n    Generate a random password with a specified length and number of digits.\\n\\n    The function creates a random password consisting of letters and digits. The total length of the password\\n    and the number of digits in it are specified by the user. The characters in the password are randomly\\n    shuffled to ensure variability.\\n\\n    Parameters:\\n    - length (int): The total length of the password. Must be a positive integer.\\n    - num_digits (int): The number of digits to be included in the password. Must be a non-negative integer and\\n                      less than or equal to the total length of the password.\\n\\n    Returns:\\n    - str: A string representing the randomly generated password.\\n\\n    Requirements:\\n    - random\\n    - string\\n\\n    Examples:\\n    >>> task_func(10, 3)\\n    'Vpbr812Ooh'\\n    >>> task_func(5, 2)\\n    '4Ob3h'\\n    \\\"\\\"\\\"\\n\",\"entry_point\":\"task_func\",\"instruct_prompt\":\"Generate a random password with a specified length and number of digits. The function creates a random password consisting of letters and digits. The total length of the password and the number of digits in it are specified by the user. The characters in the password are randomly shuffled to ensure variability.\\nThe function should output with:\\n    str: A string representing the randomly generated password.\\nYou should write self-contained code starting with:\\n```\\nimport random\\nimport string\\n# Constants\\nLETTERS = string.ascii_letters\\nDIGITS = string.digits\\ndef task_func(length, num_digits):\\n```\",\"libs\":\"['random', 'string']\"}","display_format":"code","language":"","answer_status":"published","assets":[],"source_url":"https://bigcode-bench.github.io/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}