{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bigcodebench","formal_name":"BigCodeBench","introduction":"BigCodeBench poses 1,140 function-level tasks drawn across 139 libraries. It tests whether a model can compose several real APIs correctly rather than write one self-contained function.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://bigcode-bench.github.io/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2b1fa4b5-fa6a-58dd-9288-66a0e9573f27","task_key":"default--v0~2e1~2e0~5fhf--2b1fa4b5-fa6a-58dd-9288-66a0e9573f27","task_revision_id":"1","upstream_id":"","short_description":"BigCodeBench v0.1.0_hf 2b1fa4b5-fa6a-58dd-9288-66a0e9573f27","config":"default","split":"v0.1.0_hf","body":"{\"code_prompt\":\"import re\\nimport urllib.parse\\nimport requests\\nimport json\\ndef task_func(myString, API_KEY):\\n\",\"complete_prompt\":\"import re\\nimport urllib.parse\\nimport requests\\nimport json\\n\\ndef task_func(myString, API_KEY):\\n    \\\"\\\"\\\"\\n    Extracts all URLs from the provided string, analyzes each URL to extract the domain, and uses the IP API to get the geolocation data for each domain.\\n    \\n    Parameters:\\n    myString (str): The string from which URLs are to be extracted.\\n    API_KEY (str): The API key for accessing the IP API service which provides geolocation data.\\n    \\n    Returns:\\n    dict: A dictionary mapping domains to their geolocation data as returned by the IP API. Each entry contains fields like 'status', 'country', 'region', 'city', etc. If an API request fails, the corresponding value will be None.\\n    \\n    Requirements:\\n    - re\\n    - urllib.parse\\n    - requests\\n    - json\\n    \\n    Example:\\n    >>> task_func(\\\"Check these links: http://www.google.com, https://www.python.org\\\")\\n    {'www.google.com': {'status': 'success', 'country': 'United States', 'countryCode': 'US', 'region': 'CA', 'regionName': 'California', 'city': 'Mountain View', 'zip': '94043', 'lat': '37.4192', 'lon': '-122.0574', 'timezone': 'America/Los_Angeles', 'isp': 'Google LLC', 'org': 'Google LLC', 'as': 'AS15169 Google LLC', 'query': '172.217.12.142'}, 'www.python.org': {'status': 'success', 'country': 'United States', 'countryCode': 'US', 'region': 'OR', 'regionName': 'Oregon', 'city': 'Boardman', 'zip': '97818', 'lat': '45.8696', 'lon': '-119.688', 'timezone': 'America/Los_Angeles', 'isp': 'Amazon.com, Inc.', 'org': 'Amazon Data Services NoVa', 'as': 'AS16509 Amazon.com, Inc.', 'query': '151.101.193.223'}}\\n    \\\"\\\"\\\"\\n\",\"entry_point\":\"task_func\",\"instruct_prompt\":\"Extracts all URLs from the provided string, analyzes each URL to extract the domain, and uses the IP API to get the geolocation data for each domain.\\nThe function should output with:\\n    dict: A dictionary mapping domains to their geolocation data as returned by the IP API. Each entry contains fields like 'status', 'country', 'region', 'city', etc. If an API request fails, the corresponding value will be None.\\nYou should write self-contained code starting with:\\n```\\nimport re\\nimport urllib.parse\\nimport requests\\nimport json\\ndef task_func(myString, API_KEY):\\n```\",\"libs\":\"['urllib', 're', 'requests', 'json']\"}","display_format":"code","language":"","answer_status":"published","assets":[],"source_url":"https://bigcode-bench.github.io/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}