{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bigcodebench","formal_name":"BigCodeBench","introduction":"BigCodeBench poses 1,140 function-level tasks drawn across 139 libraries. It tests whether a model can compose several real APIs correctly rather than write one self-contained function.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://bigcode-bench.github.io/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8f9a19e4-834b-5ec8-afac-6b77024f2ad3","task_key":"default--v0~2e1~2e0~5fhf--8f9a19e4-834b-5ec8-afac-6b77024f2ad3","task_revision_id":"1","upstream_id":"","short_description":"BigCodeBench v0.1.0_hf 8f9a19e4-834b-5ec8-afac-6b77024f2ad3","config":"default","split":"v0.1.0_hf","body":"{\"code_prompt\":\"import re\\nfrom collections import Counter\\n# Predefined list of common stopwords\\nPREDEFINED_STOPWORDS = {\\n    \\\"i\\\", \\\"me\\\", \\\"my\\\", \\\"myself\\\", \\\"we\\\", \\\"our\\\", \\\"ours\\\", \\\"ourselves\\\", \\\"you\\\", \\\"your\\\", \\\"yours\\\", \\n    \\\"yourself\\\", \\\"yourselves\\\", \\\"he\\\", \\\"him\\\", \\\"his\\\", \\\"himself\\\", \\\"she\\\", \\\"her\\\", \\\"hers\\\", \\n    \\\"herself\\\", \\\"it\\\", \\\"its\\\", \\\"itself\\\", \\\"they\\\", \\\"them\\\", \\\"their\\\", \\\"theirs\\\", \\\"themselves\\\", \\n    \\\"what\\\", \\\"which\\\", \\\"who\\\", \\\"whom\\\", \\\"this\\\", \\\"that\\\", \\\"these\\\", \\\"those\\\", \\\"am\\\", \\\"is\\\", \\\"are\\\", \\n    \\\"was\\\", \\\"were\\\", \\\"be\\\", \\\"been\\\", \\\"being\\\", \\\"have\\\", \\\"has\\\", \\\"had\\\", \\\"having\\\", \\\"do\\\", \\\"does\\\", \\n    \\\"did\\\", \\\"doing\\\", \\\"a\\\", \\\"an\\\", \\\"the\\\", \\\"and\\\", \\\"but\\\", \\\"if\\\", \\\"or\\\", \\\"because\\\", \\\"as\\\", \\\"until\\\", \\n    \\\"while\\\", \\\"of\\\", \\\"at\\\", \\\"by\\\", \\\"for\\\", \\\"with\\\", \\\"about\\\", \\\"against\\\", \\\"between\\\", \\\"into\\\", \\n    \\\"through\\\", \\\"during\\\", \\\"before\\\", \\\"after\\\", \\\"above\\\", \\\"below\\\", \\\"to\\\", \\\"from\\\", \\\"up\\\", \\\"down\\\", \\n    \\\"in\\\", \\\"out\\\", \\\"on\\\", \\\"off\\\", \\\"over\\\", \\\"under\\\", \\\"again\\\", \\\"further\\\", \\\"then\\\", \\\"once\\\", \\\"more\\\"\\n}\\ndef task_func(text):\\n\",\"complete_prompt\":\"import re\\nfrom collections import Counter\\n\\n# Predefined list of common stopwords\\nPREDEFINED_STOPWORDS = {\\n    \\\"i\\\", \\\"me\\\", \\\"my\\\", \\\"myself\\\", \\\"we\\\", \\\"our\\\", \\\"ours\\\", \\\"ourselves\\\", \\\"you\\\", \\\"your\\\", \\\"yours\\\", \\n    \\\"yourself\\\", \\\"yourselves\\\", \\\"he\\\", \\\"him\\\", \\\"his\\\", \\\"himself\\\", \\\"she\\\", \\\"her\\\", \\\"hers\\\", \\n    \\\"herself\\\", \\\"it\\\", \\\"its\\\", \\\"itself\\\", \\\"they\\\", \\\"them\\\", \\\"their\\\", \\\"theirs\\\", \\\"themselves\\\", \\n    \\\"what\\\", \\\"which\\\", \\\"who\\\", \\\"whom\\\", \\\"this\\\", \\\"that\\\", \\\"these\\\", \\\"those\\\", \\\"am\\\", \\\"is\\\", \\\"are\\\", \\n    \\\"was\\\", \\\"were\\\", \\\"be\\\", \\\"been\\\", \\\"being\\\", \\\"have\\\", \\\"has\\\", \\\"had\\\", \\\"having\\\", \\\"do\\\", \\\"does\\\", \\n    \\\"did\\\", \\\"doing\\\", \\\"a\\\", \\\"an\\\", \\\"the\\\", \\\"and\\\", \\\"but\\\", \\\"if\\\", \\\"or\\\", \\\"because\\\", \\\"as\\\", \\\"until\\\", \\n    \\\"while\\\", \\\"of\\\", \\\"at\\\", \\\"by\\\", \\\"for\\\", \\\"with\\\", \\\"about\\\", \\\"against\\\", \\\"between\\\", \\\"into\\\", \\n    \\\"through\\\", \\\"during\\\", \\\"before\\\", \\\"after\\\", \\\"above\\\", \\\"below\\\", \\\"to\\\", \\\"from\\\", \\\"up\\\", \\\"down\\\", \\n    \\\"in\\\", \\\"out\\\", \\\"on\\\", \\\"off\\\", \\\"over\\\", \\\"under\\\", \\\"again\\\", \\\"further\\\", \\\"then\\\", \\\"once\\\", \\\"more\\\"\\n}\\n\\ndef task_func(text):\\n    \\\"\\\"\\\"\\n    Count the stopwords found in the text after you have removed URLs.\\n\\n    Parameters:\\n    text (str): The text to summarize.\\n\\n    Returns:\\n    list: A list of tuples where each tuple contains a word and its frequency.\\n\\n    Requirements:\\n    - re\\n    - collection.Counter\\n\\n    Example:\\n    >>> task_func('Visit https://www.python.org for more info. Python is great, we love Python.')\\n    [('for', 1), ('more', 1), ('is', 1), ('we', 1)]\\n    >>> task_func('Visit https://www.python.org for more info. Python is great, we love Python, and we also love Rust.')\\n    [('for', 1), ('more', 1), ('is', 1), ('we', 2), ('and', 1)]\\n\\n    Note:\\n    - Valid url is start with http or https\\n    - The capitilization need to macth the stopwords\\n    \\\"\\\"\\\"\\n\",\"entry_point\":\"task_func\",\"instruct_prompt\":\"Count the stopwords found in the text after you have removed URLs.\\nNote that: Valid url is start with http or https The capitilization need to macth the stopwords\\nThe function should output with:\\n    list: A list of tuples where each tuple contains a word and its frequency.\\nYou should write self-contained code starting with:\\n```\\nimport re\\nfrom collections import Counter\\n# Predefined list of common stopwords\\nPREDEFINED_STOPWORDS = {\\n    \\\"i\\\", \\\"me\\\", \\\"my\\\", \\\"myself\\\", \\\"we\\\", \\\"our\\\", \\\"ours\\\", \\\"ourselves\\\", \\\"you\\\", \\\"your\\\", \\\"yours\\\", \\n    \\\"yourself\\\", \\\"yourselves\\\", \\\"he\\\", \\\"him\\\", \\\"his\\\", \\\"himself\\\", \\\"she\\\", \\\"her\\\", \\\"hers\\\", \\n    \\\"herself\\\", \\\"it\\\", \\\"its\\\", \\\"itself\\\", \\\"they\\\", \\\"them\\\", \\\"their\\\", \\\"theirs\\\", \\\"themselves\\\", \\n    \\\"what\\\", \\\"which\\\", \\\"who\\\", \\\"whom\\\", \\\"this\\\", \\\"that\\\", \\\"these\\\", \\\"those\\\", \\\"am\\\", \\\"is\\\", \\\"are\\\", \\n    \\\"was\\\", \\\"were\\\", \\\"be\\\", \\\"been\\\", \\\"being\\\", \\\"have\\\", \\\"has\\\", \\\"had\\\", \\\"having\\\", \\\"do\\\", \\\"does\\\", \\n    \\\"did\\\", \\\"doing\\\", \\\"a\\\", \\\"an\\\", \\\"the\\\", \\\"and\\\", \\\"but\\\", \\\"if\\\", \\\"or\\\", \\\"because\\\", \\\"as\\\", \\\"until\\\", \\n    \\\"while\\\", \\\"of\\\", \\\"at\\\", \\\"by\\\", \\\"for\\\", \\\"with\\\", \\\"about\\\", \\\"against\\\", \\\"between\\\", \\\"into\\\", \\n    \\\"through\\\", \\\"during\\\", \\\"before\\\", \\\"after\\\", \\\"above\\\", \\\"below\\\", \\\"to\\\", \\\"from\\\", \\\"up\\\", \\\"down\\\", \\n    \\\"in\\\", \\\"out\\\", \\\"on\\\", \\\"off\\\", \\\"over\\\", \\\"under\\\", \\\"again\\\", \\\"further\\\", \\\"then\\\", \\\"once\\\", \\\"more\\\"\\n}\\ndef task_func(text):\\n```\",\"libs\":\"['collections', 're']\"}","display_format":"code","language":"","answer_status":"published","assets":[],"source_url":"https://bigcode-bench.github.io/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}