{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bigcodebench","formal_name":"BigCodeBench","introduction":"BigCodeBench poses 1,140 function-level tasks drawn across 139 libraries. It tests whether a model can compose several real APIs correctly rather than write one self-contained function.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://bigcode-bench.github.io/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"63ce1bfb-6e5d-5ee7-b711-bf64d07c290b","task_key":"default--v0~2e1~2e0~5fhf--63ce1bfb-6e5d-5ee7-b711-bf64d07c290b","task_revision_id":"1","upstream_id":"","short_description":"BigCodeBench v0.1.0_hf 63ce1bfb-6e5d-5ee7-b711-bf64d07c290b","config":"default","split":"v0.1.0_hf","body":"{\"code_prompt\":\"import collections\\nimport random\\n# Constants\\nLETTERS = ['a', 'b', 'c', 'd', 'e', 'f', 'g', 'h', 'i', 'j']\\ndef task_func(n_keys, n_values):\\n\",\"complete_prompt\":\"import collections\\nimport random\\n\\n# Constants\\nLETTERS = ['a', 'b', 'c', 'd', 'e', 'f', 'g', 'h', 'i', 'j']\\n\\ndef task_func(n_keys, n_values):\\n    \\\"\\\"\\\"\\n    Create a Python dictionary with a specified number of keys and values. \\n\\n    Parameters:\\n    n_keys (int): The number of keys to generate.\\n    n_values (int): The number of values for each key (consecutive integers starting from 1).\\n\\n    Returns:\\n    dict: A Python dictionary with keys as strings and values as lists of integers.\\n\\n    Note: \\n    - Keys are randomly selected from a predefined list of letters, and values are consecutive integers starting from 1.\\n    - Due to the randomness in key selection, the actual keys in the dictionary may vary in each execution.\\n\\n    Requirements:\\n    - collections\\n    - random\\n\\n    Example:\\n    >>> random.seed(0)\\n    >>> task_func(3, 5)\\n    {'g': [1, 2, 3, 4, 5], 'a': [1, 2, 3, 4, 5]}\\n    >>> result = task_func(1, 5)\\n    >>> list(result)[0] in LETTERS\\n    True\\n    \\\"\\\"\\\"\\n\",\"entry_point\":\"task_func\",\"instruct_prompt\":\"Create a Python dictionary with a specified number of keys and values.\\nNote that: Keys are randomly selected from a predefined list of letters, and values are consecutive integers starting from 1. Due to the randomness in key selection, the actual keys in the dictionary may vary in each execution.\\nThe function should output with:\\n    dict: A Python dictionary with keys as strings and values as lists of integers.\\nYou should write self-contained code starting with:\\n```\\nimport collections\\nimport random\\n# Constants\\nLETTERS = ['a', 'b', 'c', 'd', 'e', 'f', 'g', 'h', 'i', 'j']\\ndef task_func(n_keys, n_values):\\n```\",\"libs\":\"['collections', 'random']\"}","display_format":"code","language":"","answer_status":"published","assets":[],"source_url":"https://bigcode-bench.github.io/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}