{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bigcodebench","formal_name":"BigCodeBench","introduction":"BigCodeBench poses 1,140 function-level tasks drawn across 139 libraries. It tests whether a model can compose several real APIs correctly rather than write one self-contained function.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://bigcode-bench.github.io/","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"c83916a4-2567-558a-973e-7a399c47f570","task_key":"default--v0~2e1~2e0~5fhf--c83916a4-2567-558a-973e-7a399c47f570","task_revision_id":"2","upstream_id":"","short_description":"BigCodeBench v0.1.0_hf c83916a4-2567-558a-973e-7a399c47f570","config":"default","split":"v0.1.0_hf","body":"{\"code_prompt\":\"import re\\nimport json\\nimport requests\\ndef task_func(data_url: str) -> list:\\n\",\"complete_prompt\":\"import re\\nimport json\\nimport requests\\n\\ndef task_func(data_url: str) -> list:\\n    \\\"\\\"\\\"\\n    Fetch data from a specific URL and extract all names from the JSON-formatted data that are not enclosed by square brackets.\\n    No specific status code should be raised.\\n    \\n    Note:\\n    - The function uses regular expressions to search for names in the fetched data. Names that are inside square\\n    brackets are ignored.\\n    - The function will return \\\"Invalid url input\\\" if any exception is raised during the request.\\n\\n    Parameters:\\n    - data_url (str): The URL from which to fetch data.\\n\\n    Returns:\\n    - list[str]: A list of extracted names.\\n\\n    Requirements:\\n    - re\\n    - json\\n    - requests\\n\\n    Example:\\n    >>> import json\\n    >>> from unittest.mock import MagicMock\\n    >>> from io import BytesIO\\n    >>> mock_response = MagicMock()\\n    >>> mock_response.json.return_value = {\\\"names\\\": [\\\"John\\\", \\\"[Adam]\\\", \\\"Eve\\\"]}\\n    >>> requests.get = MagicMock(return_value=mock_response)\\n    >>> task_func(\\\"https://api.example.com/other_data\\\")\\n    ['John', 'Eve']\\n    \\\"\\\"\\\"\\n\",\"entry_point\":\"task_func\",\"instruct_prompt\":\"Fetch data from a specific URL and extract all names from the JSON-formatted data that are not enclosed by square brackets. No specific status code should be raised.\\nNote that: The function uses regular expressions to search for names in the fetched data. Names that are inside square brackets are ignored. The function will return \\\"Invalid url input\\\" if any exception is raised during the request.\\nThe function should output with:\\n    list[str]: A list of extracted names.\\nYou should write self-contained code starting with:\\n```\\nimport re\\nimport json\\nimport requests\\ndef task_func(data_url: str) -> list:\\n```\",\"libs\":\"['re', 'requests', 'json']\"}","display_format":"code","language":"","answer_status":"published","assets":[],"source_url":"https://bigcode-bench.github.io/","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}