{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bigcodebench","formal_name":"BigCodeBench","introduction":"BigCodeBench poses 1,140 function-level tasks drawn across 139 libraries. It tests whether a model can compose several real APIs correctly rather than write one self-contained function.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://bigcode-bench.github.io/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"87fdfb58-0096-507f-9990-d94dd2c681d7","task_key":"default--v0~2e1~2e0~5fhf--87fdfb58-0096-507f-9990-d94dd2c681d7","task_revision_id":"1","upstream_id":"","short_description":"BigCodeBench v0.1.0_hf 87fdfb58-0096-507f-9990-d94dd2c681d7","config":"default","split":"v0.1.0_hf","body":"{\"code_prompt\":\"import numpy as np\\nimport random\\ndef task_func(MIN_WORDS, MAX_WORDS, WORDS_POOL):\\n\",\"complete_prompt\":\"import numpy as np\\nimport random\\n\\ndef task_func(MIN_WORDS, MAX_WORDS, WORDS_POOL):\\n    \\\"\\\"\\\"\\n    Generates a palindrome sentence using random words from a specified pool. The sentence's length is randomly\\n    chosen between a minimum (MIN_WORDS) and maximum (MAX_WORDS) number of words. The function ensures that the\\n    sentence reads the same forwards and backwards.\\n\\n    Parameters:\\n    MIN_WORDS (int): Minimum number of words in the palindrome sentence.\\n    MAX_WORDS (int): Maximum number of words in the palindrome sentence.\\n    WORDS_POOL (list): List of words to choose from for generating the palindrome.\\n\\n    Returns:\\n    str: The generated palindrome sentence.\\n\\n    Requirements:\\n    - numpy\\n    - random\\n\\n    Examples:\\n    Generate a palindrome sentence and check if it's indeed a palindrome.\\n    >>> MIN_WORDS, MAX_WORDS, WORDS_POOL = 3, 10, ['apple', 'banana', 'racecar', 'world', 'level', 'madam', 'radar', 'rotor']\\n    >>> sentence = task_func(MIN_WORDS, MAX_WORDS, WORDS_POOL)\\n    >>> re_sentence = \\\" \\\".join(sentence.split()[::-1])\\n    >>> sentence == re_sentence\\n    True\\n\\n    Check if the generated sentence length is within the specified range.\\n    >>> sentence = task_func(MIN_WORDS, MAX_WORDS, WORDS_POOL)\\n    >>> MIN_WORDS <= len(sentence.split()) <= MAX_WORDS\\n    True\\n    \\\"\\\"\\\"\\n\",\"entry_point\":\"task_func\",\"instruct_prompt\":\"Generates a palindrome sentence using random words from a specified pool. The sentence's length is randomly chosen between a minimum (MIN_WORDS) and maximum (MAX_WORDS) number of words. The function ensures that the sentence reads the same forwards and backwards. Check if the generated sentence length is within the specified range. >>> sentence = task_func(MIN_WORDS, MAX_WORDS, WORDS_POOL) >>> MIN_WORDS <= len(sentence.split()) <= MAX_WORDS True\\nThe function should output with:\\n    str: The generated palindrome sentence.\\nYou should write self-contained code starting with:\\n```\\nimport numpy as np\\nimport random\\ndef task_func(MIN_WORDS, MAX_WORDS, WORDS_POOL):\\n```\",\"libs\":\"['numpy', 'random']\"}","display_format":"code","language":"","answer_status":"published","assets":[],"source_url":"https://bigcode-bench.github.io/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}