{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bigcodebench","formal_name":"BigCodeBench","introduction":"BigCodeBench poses 1,140 function-level tasks drawn across 139 libraries. It tests whether a model can compose several real APIs correctly rather than write one self-contained function.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://bigcode-bench.github.io/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"45ddf65f-528f-51ea-8b53-6325144c38e8","task_key":"default--v0~2e1~2e0~5fhf--45ddf65f-528f-51ea-8b53-6325144c38e8","task_revision_id":"1","upstream_id":"","short_description":"BigCodeBench v0.1.0_hf 45ddf65f-528f-51ea-8b53-6325144c38e8","config":"default","split":"v0.1.0_hf","body":"{\"code_prompt\":\"import re\\nimport json\\nimport requests\\ndef task_func(myString, token):\\n\",\"complete_prompt\":\"import re\\nimport json\\nimport requests\\n\\ndef task_func(myString, token):\\n    \\\"\\\"\\\"\\n    Extracts a URL from a string and sends it to a REST API via a POST request. The URL is included in the JSON payload,\\n    and an authorization token is used in the headers for API access. If multiple URL is in myString, then use the first one\\n\\n    Parameters:\\n    myString (str): The string from which to extract the URL.\\n    token (str): The authorization token required for API access.\\n\\n    Returns:\\n    dict: The response from the API, which varies based on the API's implementation.\\n\\n    Requirements:\\n    - re\\n    - json\\n    - requests\\n\\n    Example:\\n    >>> task_func('Please check: https://www.google.com', 'your_token_here')\\n    {'message': 'URL received'}\\n    \\\"\\\"\\\"\\n\",\"entry_point\":\"task_func\",\"instruct_prompt\":\"Extracts a URL from a string and sends it to a REST API via a POST request. The URL is included in the JSON payload, and an authorization token is used in the headers for API access. If multiple URL is in myString, then use the first one\\nThe function should output with:\\n    dict: The response from the API, which varies based on the API's implementation.\\nYou should write self-contained code starting with:\\n```\\nimport re\\nimport json\\nimport requests\\ndef task_func(myString, token):\\n```\",\"libs\":\"['requests', 're', 'json']\"}","display_format":"code","language":"","answer_status":"published","assets":[],"source_url":"https://bigcode-bench.github.io/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}