{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bigcodebench","formal_name":"BigCodeBench","introduction":"BigCodeBench poses 1,140 function-level tasks drawn across 139 libraries. It tests whether a model can compose several real APIs correctly rather than write one self-contained function.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://bigcode-bench.github.io/","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"fc3aa5b2-0739-5b65-a1eb-a72e021ba17b","task_key":"default--v0~2e1~2e0~5fhf--fc3aa5b2-0739-5b65-a1eb-a72e021ba17b","task_revision_id":"2","upstream_id":"","short_description":"BigCodeBench v0.1.0_hf fc3aa5b2-0739-5b65-a1eb-a72e021ba17b","config":"default","split":"v0.1.0_hf","body":"{\"code_prompt\":\"import ipaddress\\nimport requests\\ndef task_func(ip_range, timeout):\\n\",\"complete_prompt\":\"import ipaddress\\nimport requests\\n\\ndef task_func(ip_range, timeout):\\n    \\\"\\\"\\\"\\n    Scans a specified IP address range and sends an HTTP GET request to each IP to verify if it is an active web server.\\n    The function requires an IP range in CIDR format (e.g., '192.168.0.0/16') and a timeout value in seconds.\\n    It returns a list of IPs where the request returned a status code of 200. If the request is not success, then ignore and continue\\n    to the next IP address.\\n\\n    Parameters:\\n        ip_range (str): The IP range to scan in CIDR notation.\\n        timeout (int): The timeout for each HTTP GET request in seconds.\\n\\n    Requirements:\\n        - ipaddress\\n        - requests\\n\\n    Returns:\\n        list: A list of IP addresses that responded with a status code of 200.\\n\\n    Raises:\\n        ValueError: If an invalid IP range is provided.\\n\\n    Examples:\\n    >>> type(task_func('192.168.0.0/16', 5)) is list\\n    True\\n    >>> isinstance(task_func('192.168.0.0/16', 5), list)\\n    True\\n    \\\"\\\"\\\"\\n\",\"entry_point\":\"task_func\",\"instruct_prompt\":\"Scans a specified IP address range and sends an HTTP GET request to each IP to verify if it is an active web server. The function requires an IP range in CIDR format (e.g., '192.168.0.0/16') and a timeout value in seconds. It returns a list of IPs where the request returned a status code of 200. If the request is not success, then ignore and continue to the next IP address.\\nThe function should raise the exception for: ValueError: If an invalid IP range is provided.\\nThe function should output with:\\n    list: A list of IP addresses that responded with a status code of 200.\\nYou should write self-contained code starting with:\\n```\\nimport ipaddress\\nimport requests\\ndef task_func(ip_range, timeout):\\n```\",\"libs\":\"['requests', 'ipaddress']\"}","display_format":"code","language":"","answer_status":"published","assets":[],"source_url":"https://bigcode-bench.github.io/","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}