{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bigcodebench","formal_name":"BigCodeBench","introduction":"BigCodeBench poses 1,140 function-level tasks drawn across 139 libraries. It tests whether a model can compose several real APIs correctly rather than write one self-contained function.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://bigcode-bench.github.io/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f005fb28-9313-5b5a-90b3-790bbd8391df","task_key":"default--v0~2e1~2e0~5fhf--f005fb28-9313-5b5a-90b3-790bbd8391df","task_revision_id":"1","upstream_id":"","short_description":"BigCodeBench v0.1.0_hf f005fb28-9313-5b5a-90b3-790bbd8391df","config":"default","split":"v0.1.0_hf","body":"{\"code_prompt\":\"import re\\nimport random\\nimport string\\ndef task_func(n, pattern, seed=None):\\n\",\"complete_prompt\":\"import re\\nimport random\\nimport string\\n\\ndef task_func(n, pattern, seed=None):\\n    \\\"\\\"\\\"\\n    Generate a random string of length 'n' and find all non-overlapping matches\\n    of the regex 'pattern'.\\n\\n    The function generates a random string of ASCII Letters and Digits using \\n    the random module. By providing a seed the results are reproducable.\\n    Non overlapping matches of the provided pattern are then found using the re\\n    module.\\n    \\n    Parameters:\\n    n (int): The length of the random string to be generated.\\n    pattern (str): The regex pattern to search for in the random string.\\n    seed (int, optional): A seed parameter for the random number generator for reproducible results. Defaults to None.\\n\\n    Returns:\\n    list: A list of all non-overlapping matches of the regex pattern in the generated string.\\n\\n    Requirements:\\n    - re\\n    - random\\n    - string\\n\\n    Example:\\n    >>> task_func(100, r'[A-Za-z]{5}', seed=12345)\\n    ['mrKBk', 'BqJOl', 'NJlwV', 'UfHVA', 'LGkjn', 'vubDv', 'GSVAa', 'kXLls', 'RKlVy', 'vZcoh', 'FnVZW', 'JQlqL']\\n\\n    >>> task_func(1000, r'[1-9]{2}', seed=1)\\n    ['51', '84', '16', '79', '16', '28', '63', '82', '94', '18', '68', '42', '95', '33', '64', '38', '69', '56', '32', '16', '18', '19', '27']\\n     \\\"\\\"\\\"\\n\",\"entry_point\":\"task_func\",\"instruct_prompt\":\"Generate a random string of length 'n' and find all non-overlapping matches of the regex 'pattern'. The function generates a random string of ASCII Letters and Digits using the random module. By providing a seed the results are reproducable. Non overlapping matches of the provided pattern are then found using the re module. >>> task_func(1000, r'[1-9]{2}', seed=1) ['51', '84', '16', '79', '16', '28', '63', '82', '94', '18', '68', '42', '95', '33', '64', '38', '69', '56', '32', '16', '18', '19', '27']\\nThe function should output with:\\n    list: A list of all non-overlapping matches of the regex pattern in the generated string.\\nYou should write self-contained code starting with:\\n```\\nimport re\\nimport random\\nimport string\\ndef task_func(n, pattern, seed=None):\\n```\",\"libs\":\"['random', 'string', 're']\"}","display_format":"code","language":"","answer_status":"published","assets":[],"source_url":"https://bigcode-bench.github.io/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}