{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bigcodebench","formal_name":"BigCodeBench","introduction":"BigCodeBench poses 1,140 function-level tasks drawn across 139 libraries. It tests whether a model can compose several real APIs correctly rather than write one self-contained function.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://bigcode-bench.github.io/","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"32244cff-1198-5530-a25a-24cdcc436710","task_key":"default--v0~2e1~2e0~5fhf--32244cff-1198-5530-a25a-24cdcc436710","task_revision_id":"2","upstream_id":"","short_description":"BigCodeBench v0.1.0_hf 32244cff-1198-5530-a25a-24cdcc436710","config":"default","split":"v0.1.0_hf","body":"{\"code_prompt\":\"import random\\nimport math\\ndef task_func(LETTERS=[chr(i) for i in range(97, 123)]):\\n\",\"complete_prompt\":\"import random\\nimport math\\n\\ndef task_func(LETTERS=[chr(i) for i in range(97, 123)]):\\n    \\\"\\\"\\\"\\n    Create a dictionary where keys are letters from a predefined list LETTERS and values are lists of random integers.\\n    Then, calculates the population standard deviation for each list of integers and returns a dictionary of these values.\\n\\n    The random integers for each key are generated within the range 0 to 100, and each list contains between 1 to 10 integers.\\n\\n    Parameters:\\n        LETTERS (list of str, optional): A list of single-character strings to be used as keys in the output dictionary.\\n                                         Defaults to the lowercase English alphabets ['a', 'b', ..., 'z'].\\n\\n    Returns:\\n        dict: A dictionary where each key corresponds to a letter from the input list and each value is the \\n              population standard deviation of a list of random integers associated with that key.\\n\\n    Requirements:\\n    - random\\n    - math\\n\\n    Example:\\n    >>> import random\\n    >>> random.seed(42)\\n    >>> sd_dict = task_func()\\n    >>> print(sd_dict)\\n    {'a': 45.5, 'b': 29.4659125092029, 'c': 25.575354649194974, 'd': 28.271717316074028, 'e': 29.118550788114437, 'f': 16.886056048968, 'g': 27.48108440364026, 'h': 32.67476090195611, 'i': 8.5, 'j': 17.5406234036238, 'k': 22.993205518152532, 'l': 2.0, 'm': 25.468935326524086, 'n': 10.23067283548187, 'o': 35.13922924736349, 'p': 26.649654437396617, 'q': 27.027763503479157, 'r': 20.316629447296748, 's': 24.997777679003566, 't': 0.0, 'u': 30.070288030250428, 'v': 21.82864622275892, 'w': 37.92308004368844, 'x': 29.899006961502092, 'y': 33.89321466016465, 'z': 21.0}\\n    \\\"\\\"\\\"\\n\",\"entry_point\":\"task_func\",\"instruct_prompt\":\"Create a dictionary where keys are letters from a predefined list LETTERS and values are lists of random integers. Then, calculates the population standard deviation for each list of integers and returns a dictionary of these values. The random integers for each key are generated within the range 0 to 100, and each list contains between 1 to 10 integers.\\nThe function should output with:\\n    dict: A dictionary where each key corresponds to a letter from the input list and each value is the\\n    population standard deviation of a list of random integers associated with that key.\\nYou should write self-contained code starting with:\\n```\\nimport random\\nimport math\\ndef task_func(LETTERS=[chr(i) for i in range(97, 123)]):\\n```\",\"libs\":\"['math', 'random']\"}","display_format":"code","language":"","answer_status":"published","assets":[],"source_url":"https://bigcode-bench.github.io/","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}