{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bigcodebench","formal_name":"BigCodeBench","introduction":"BigCodeBench poses 1,140 function-level tasks drawn across 139 libraries. It tests whether a model can compose several real APIs correctly rather than write one self-contained function.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://bigcode-bench.github.io/","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"406a8d23-d62f-52a0-a870-6f44bab8c893","task_key":"default--v0~2e1~2e0~5fhf--406a8d23-d62f-52a0-a870-6f44bab8c893","task_revision_id":"2","upstream_id":"","short_description":"BigCodeBench v0.1.0_hf 406a8d23-d62f-52a0-a870-6f44bab8c893","config":"default","split":"v0.1.0_hf","body":"{\"code_prompt\":\"import math\\nimport itertools\\nfrom functools import reduce\\ndef task_func(numbers):\\n\",\"complete_prompt\":\"import math\\nimport itertools\\nfrom functools import reduce\\n\\ndef task_func(numbers):\\n    \\\"\\\"\\\"\\n    Generates all possible combinations of the provided numbers in a given list for\\n    each possible length. For each combination, it computes the product of the numbers\\n    in the combination. It then computes the logarithm of each product and sums these\\n    logarithms to produce the final result.\\n\\n    Parameters:\\n        numbers (list of int): A list of integers for which combinations are formed.\\n\\n    Requirements:\\n    - math\\n    - itertools\\n    - functools\\n\\n    Returns:\\n        float: The sum of the logarithms of the products of all combinations of numbers.\\n\\n    Examples:\\n    >>> numbers = [2, 3, 5, 7, 11, 13, 17, 19, 23, 29]\\n    >>> type(task_func(numbers)) == float\\n    True\\n    >>> isinstance(task_func(numbers), float)\\n    True\\n    \\\"\\\"\\\"\\n\",\"entry_point\":\"task_func\",\"instruct_prompt\":\"Generates all possible combinations of the provided numbers in a given list for each possible length. For each combination, it computes the product of the numbers in the combination. It then computes the logarithm of each product and sums these logarithms to produce the final result.\\nThe function should output with:\\n    float: The sum of the logarithms of the products of all combinations of numbers.\\nYou should write self-contained code starting with:\\n```\\nimport math\\nimport itertools\\nfrom functools import reduce\\ndef task_func(numbers):\\n```\",\"libs\":\"['math', 'itertools', 'functools']\"}","display_format":"code","language":"","answer_status":"published","assets":[],"source_url":"https://bigcode-bench.github.io/","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}