{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bigcodebench","formal_name":"BigCodeBench","introduction":"BigCodeBench poses 1,140 function-level tasks drawn across 139 libraries. It tests whether a model can compose several real APIs correctly rather than write one self-contained function.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://bigcode-bench.github.io/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ffc64f00-4f78-581f-b0d0-d8142ea5611e","task_key":"default--v0~2e1~2e0~5fhf--ffc64f00-4f78-581f-b0d0-d8142ea5611e","task_revision_id":"1","upstream_id":"","short_description":"BigCodeBench v0.1.0_hf ffc64f00-4f78-581f-b0d0-d8142ea5611e","config":"default","split":"v0.1.0_hf","body":"{\"code_prompt\":\"import requests\\nimport os\\nimport json\\nimport time\\n# Redefining the function in the current context\\nHEADERS = {\\n    'accept': 'text/json',\\n    'Content-Type': 'application/json'\\n}\\ndef task_func(url, directory, metadata):\\n\",\"complete_prompt\":\"import requests\\nimport os\\nimport json\\nimport time\\n\\n# Redefining the function in the current context\\n\\nHEADERS = {\\n    'accept': 'text/json',\\n    'Content-Type': 'application/json'\\n}\\n\\ndef task_func(url, directory, metadata):\\n    \\\"\\\"\\\"\\n    Upload all files from a specific directory to the specified server URL, along with the associated metadata. \\n    In addition, the speed limit function pauses for one second after each upload.\\n\\n    Parameters:\\n    url (str): The server URL.\\n    directory (str): The directory containing the files to be uploaded.\\n    metadata (dict): The metadata to be associated with the files.\\n\\n    Returns:\\n    list: A list of status codes for the upload responses.\\n\\n    Requirements:\\n    - requests\\n    - os\\n    - json\\n    - time\\n\\n    Raises:\\n    - The function will raise FileNotFoundError if the directory does not exist.\\n    - The function will raise TypeError if the url is invalid.\\n\\n    Example:\\n    >>> task_func('https://www.example.com', './uploads', {'userId': 'abc'})\\n    \\\"\\\"\\\"\\n\",\"entry_point\":\"task_func\",\"instruct_prompt\":\"Upload all files from a specific directory to the specified server URL, along with the associated metadata. In addition, the speed limit function pauses for one second after each upload.\\nThe function should raise the exception for: The function will raise FileNotFoundError if the directory does not exist. The function will raise TypeError if the url is invalid.\\nThe function should output with:\\n    list: A list of status codes for the upload responses.\\nYou should write self-contained code starting with:\\n```\\nimport requests\\nimport os\\nimport json\\nimport time\\n# Redefining the function in the current context\\nHEADERS = {\\n    'accept': 'text/json',\\n    'Content-Type': 'application/json'\\n}\\ndef task_func(url, directory, metadata):\\n```\",\"libs\":\"['time', 'json', 'requests', 'os']\"}","display_format":"code","language":"","answer_status":"published","assets":[],"source_url":"https://bigcode-bench.github.io/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}