{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bigcodebench","formal_name":"BigCodeBench","introduction":"BigCodeBench poses 1,140 function-level tasks drawn across 139 libraries. It tests whether a model can compose several real APIs correctly rather than write one self-contained function.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://bigcode-bench.github.io/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5e9c01fe-6a81-54b9-a987-7aea2c6a2a4a","task_key":"default--v0~2e1~2e0~5fhf--5e9c01fe-6a81-54b9-a987-7aea2c6a2a4a","task_revision_id":"1","upstream_id":"","short_description":"BigCodeBench v0.1.0_hf 5e9c01fe-6a81-54b9-a987-7aea2c6a2a4a","config":"default","split":"v0.1.0_hf","body":"{\"code_prompt\":\"import requests\\nimport logging\\ndef task_func(repo_url: str) -> dict:\\n\",\"complete_prompt\":\"import requests\\nimport logging\\n\\ndef task_func(repo_url: str) -> dict:\\n    \\\"\\\"\\\"\\n    Fetches and returns information about a GitHub repository using its API URL. The function makes an HTTP GET\\n    request to the provided repository URL. It incorporates error handling for various scenarios including API\\n    rate limits, other HTTP errors, and general request issues. The function also checks for a large number of\\n    open issues in the repository and prints a warning if they exceed a certain threshold.\\n\\n    Parameters:\\n    - repo_url (str): The URL of the GitHub repository API.\\n\\n    Returns:\\n    - dict: A dictionary containing information about the GitHub repository.\\n\\n    Raises:\\n    - requests.exceptions.HTTPError: If an HTTP error occurs, particularly when the GitHub API rate limit is\\n            exceeded.\\n    - requests.exceptions.RequestException: For other general issues encountered during the API request, such\\n            as network problems, invalid responses, or timeouts.\\n\\n    Requirements:\\n    - requests\\n    - logging\\n\\n    Example:\\n    >>> task_func('https://api.github.com/repos/psf/requests')\\n    { ... }  # dictionary containing repo information\\n    >>> task_func('https://api.github.com/repos/some/repo')\\n    { ... }  # dictionary containing repo information with a possible runtime warning about open issues\\n    \\\"\\\"\\\"\\n\",\"entry_point\":\"task_func\",\"instruct_prompt\":\"Fetches and returns information about a GitHub repository using its API URL. The function makes an HTTP GET request to the provided repository URL. It incorporates error handling for various scenarios including API rate limits, other HTTP errors, and general request issues. The function also checks for a large number of open issues in the repository and prints a warning if they exceed a certain threshold.\\nThe function should raise the exception for: requests.exceptions.HTTPError: If an HTTP error occurs, particularly when the GitHub API rate limit is exceeded. requests.exceptions.RequestException: For other general issues encountered during the API request, such as network problems, invalid responses, or timeouts.\\nThe function should output with:\\n    dict: A dictionary containing information about the GitHub repository.\\nYou should write self-contained code starting with:\\n```\\nimport requests\\nimport logging\\ndef task_func(repo_url: str) -> dict:\\n```\",\"libs\":\"['logging', 'requests']\"}","display_format":"code","language":"","answer_status":"published","assets":[],"source_url":"https://bigcode-bench.github.io/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}