{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bigcodebench","formal_name":"BigCodeBench","introduction":"BigCodeBench poses 1,140 function-level tasks drawn across 139 libraries. It tests whether a model can compose several real APIs correctly rather than write one self-contained function.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://bigcode-bench.github.io/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"19470e43-c0a4-5a28-8a92-dd25cfd74b53","task_key":"default--v0~2e1~2e0~5fhf--19470e43-c0a4-5a28-8a92-dd25cfd74b53","task_revision_id":"1","upstream_id":"","short_description":"BigCodeBench v0.1.0_hf 19470e43-c0a4-5a28-8a92-dd25cfd74b53","config":"default","split":"v0.1.0_hf","body":"{\"code_prompt\":\"import os\\nimport ctypes\\nimport sys\\nimport subprocess\\ndef task_func(filepath):\\n\",\"complete_prompt\":\"import os\\nimport ctypes\\nimport sys\\nimport subprocess\\n\\n\\ndef task_func(filepath):\\n    \\\"\\\"\\\"\\n    Loads a DLL file specified by the given filepath, then retrieves and prints system information\\n    including system name, node name, release, version, machine, Python version, and PIP version.\\n    This function demonstrates the use of various system-related libraries in Python.\\n\\n    The format of the printed message is:\\n    System: <system-name-here>\\n    Node Name: <node-name-here>\\n    Release: <release-here>\\n    Version: <version-here>\\n    Machine: <type-of-the-machine-here>\\n    Python Version: <python-version-here> \\n    PIP Version: <pip-version-here>\\n\\n    Parameters:\\n    filepath (str): The path of the DLL file to be loaded.\\n\\n    Returns:\\n    str: The name of the loaded DLL file.\\n\\n    Raises:\\n    OSError: if the input filepath is invalid or empty\\n    TypeError: if the input filepath is not a string\\n    \\n    Requirements:\\n    - ctypes\\n    - os\\n    - sys\\n    - subprocess\\n\\n    Examples:\\n    >>> task_func('libc.so.6') # Doctest will vary based on the system and DLL file.\\n    'libc.so.6'\\n    >>> isinstance(task_func('libc.so.6'), str)\\n    True\\n    \\\"\\\"\\\"\\n\",\"entry_point\":\"task_func\",\"instruct_prompt\":\"Loads a DLL file specified by the given filepath, then retrieves and prints system information including system name, node name, release, version, machine, Python version, and PIP version. This function demonstrates the use of various system-related libraries in Python. The format of the printed message is: System: <system-name-here> Node Name: <node-name-here> Release: <release-here> Version: <version-here> Machine: <type-of-the-machine-here> Python Version: <python-version-here> PIP Version: <pip-version-here>\\nThe function should raise the exception for: OSError: if the input filepath is invalid or empty TypeError: if the input filepath is not a string\\nThe function should output with:\\n    str: The name of the loaded DLL file.\\nYou should write self-contained code starting with:\\n```\\nimport os\\nimport ctypes\\nimport sys\\nimport subprocess\\ndef task_func(filepath):\\n```\",\"libs\":\"['subprocess', 'ctypes', 'sys', 'os']\"}","display_format":"code","language":"","answer_status":"published","assets":[],"source_url":"https://bigcode-bench.github.io/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}