{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bigcodebench","formal_name":"BigCodeBench","introduction":"BigCodeBench poses 1,140 function-level tasks drawn across 139 libraries. It tests whether a model can compose several real APIs correctly rather than write one self-contained function.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://bigcode-bench.github.io/","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"6b4d4c4f-79b1-5800-9f65-4f833b9f39aa","task_key":"default--v0~2e1~2e0~5fhf--6b4d4c4f-79b1-5800-9f65-4f833b9f39aa","task_revision_id":"2","upstream_id":"","short_description":"BigCodeBench v0.1.0_hf 6b4d4c4f-79b1-5800-9f65-4f833b9f39aa","config":"default","split":"v0.1.0_hf","body":"{\"code_prompt\":\"import nltk\\nfrom string import punctuation\\nimport seaborn as sns\\nimport matplotlib.pyplot as plt\\n# Constants\\nPUNCTUATION = set(punctuation)\\ndef task_func(text):\\n\",\"complete_prompt\":\"import nltk\\nfrom string import punctuation\\nimport seaborn as sns\\nimport matplotlib.pyplot as plt\\n\\n# Constants\\nPUNCTUATION = set(punctuation)\\n\\n\\ndef task_func(text):\\n    \\\"\\\"\\\"\\n    Draw a bar chart of the frequency of words in a text beginning with the \\\"$\\\" character. Words that start with the '$' character but consist only of punctuation (e.g., '$!$' and '$.$') are not included in the frequency count.\\n    - If there is no word respecting the above conditions, the plot should be None.\\n    - The barplot x words on the x-axis and frequencies on the y-axis.\\n\\n    Parameters:\\n        - text (str): The input text.\\n    Returns:\\n        - matplotlib.axes._axes.Axes: The plot showing the frequency of words beginning with the '$' character.\\n\\n    Requirements:\\n        - nltk\\n        - string\\n        - seaborn\\n        - matplotlib\\n\\n    Example:\\n    >>> text = \\\"$child than resource indicate star $community station onto best green $exactly onto then age charge $friend than ready child really $let product coach decision professional $camera life off management factor $alone beat idea bit call $campaign fill stand Congress stuff $performance follow your resource road $data performance himself school here\\\"\\n    >>> ax = task_func(text)\\n    >>> print(ax)\\n    Axes(0.125,0.11;0.775x0.77)\\n    \\\"\\\"\\\"\\n\",\"entry_point\":\"task_func\",\"instruct_prompt\":\"Draw a bar chart of the frequency of words in a text beginning with the \\\"$\\\" character. Words that start with the '$' character but consist only of punctuation (e.g., '$!$' and '$.$') are not included in the frequency count. - If there is no word respecting the above conditions, the plot should be None. - The barplot x words on the x-axis and frequencies on the y-axis.\\nThe function should output with:\\n    matplotlib.axes._axes.Axes: The plot showing the frequency of words beginning with the '$' character.\\nYou should write self-contained code starting with:\\n```\\nimport nltk\\nfrom string import punctuation\\nimport seaborn as sns\\nimport matplotlib.pyplot as plt\\n# Constants\\nPUNCTUATION = set(punctuation)\\ndef task_func(text):\\n```\",\"libs\":\"['nltk', 'matplotlib', 'string', 'seaborn']\"}","display_format":"code","language":"","answer_status":"published","assets":[],"source_url":"https://bigcode-bench.github.io/","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}