{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bigcodebench","formal_name":"BigCodeBench","introduction":"BigCodeBench poses 1,140 function-level tasks drawn across 139 libraries. It tests whether a model can compose several real APIs correctly rather than write one self-contained function.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://bigcode-bench.github.io/","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"7a925a1f-e11f-593c-a1d3-afc31df7a7b9","task_key":"default--v0~2e1~2e0~5fhf--7a925a1f-e11f-593c-a1d3-afc31df7a7b9","task_revision_id":"2","upstream_id":"","short_description":"BigCodeBench v0.1.0_hf 7a925a1f-e11f-593c-a1d3-afc31df7a7b9","config":"default","split":"v0.1.0_hf","body":"{\"code_prompt\":\"import psutil\\nimport platform\\ndef task_func():\\n\",\"complete_prompt\":\"import psutil\\nimport platform\\n\\ndef task_func():\\n    \\\"\\\"\\\"\\n    Obtain system details, including operating system, architecture, and memory usage.\\n    \\n    This function gathers information about the system's operating system, architecture,\\n    and memory usage. It calculates the percentage of used memory  by comparing the total\\n    and currently used memory. The gathered details are then returned in a dictionary \\n    format with specific keys for each piece of information.\\n    \\n    Returns:\\n    dict: A dictionary containing:\\n        - 'OS': Operating System name (e.g., 'Windows', 'Linux').\\n        - 'Architecture': System architecture (typically first item from platform.architecture(), e.g., '64bit').\\n        - 'Memory Usage': Formatted string representing the percentage of memory currently in use, \\n                            calculated as (used memory / total memory) * 100.\\n  \\n    Requirements:\\n    - platform\\n    - psutil\\n\\n    Examples:\\n    >>> system_info = task_func()\\n    >>> isinstance(system_info, dict)\\n    True\\n    >>> 'OS' in system_info\\n    True\\n    >>> 'Architecture' in system_info\\n    True\\n    >>> 'Memory Usage' in system_info\\n    True\\n    \\\"\\\"\\\"\\n\",\"entry_point\":\"task_func\",\"instruct_prompt\":\"Obtain system details, including operating system, architecture, and memory usage. This function gathers information about the system's operating system, architecture, and memory usage. It calculates the percentage of used memory  by comparing the total and currently used memory. The gathered details are then returned in a dictionary format with specific keys for each piece of information.\\nThe function should output with:\\n    dict: A dictionary containing:\\n    'OS': Operating System name (e.g., 'Windows', 'Linux').\\n    'Architecture': System architecture (typically first item from platform.architecture(), e.g., '64bit').\\n    'Memory Usage': Formatted string representing the percentage of memory currently in use,\\n    calculated as (used memory / total memory) * 100.\\nYou should write self-contained code starting with:\\n```\\nimport psutil\\nimport platform\\ndef task_func():\\n```\",\"libs\":\"['psutil', 'platform']\"}","display_format":"code","language":"","answer_status":"published","assets":[],"source_url":"https://bigcode-bench.github.io/","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}