{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bigcodebench","formal_name":"BigCodeBench","introduction":"BigCodeBench poses 1,140 function-level tasks drawn across 139 libraries. It tests whether a model can compose several real APIs correctly rather than write one self-contained function.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://bigcode-bench.github.io/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f4211b19-5a9e-5817-9f2b-69cc9161c548","task_key":"default--v0~2e1~2e0~5fhf--f4211b19-5a9e-5817-9f2b-69cc9161c548","task_revision_id":"1","upstream_id":"","short_description":"BigCodeBench v0.1.0_hf f4211b19-5a9e-5817-9f2b-69cc9161c548","config":"default","split":"v0.1.0_hf","body":"{\"code_prompt\":\"import pandas as pd\\nimport pytz\\ndef task_func(articles, timezone):\\n\",\"complete_prompt\":\"import pandas as pd\\nimport pytz\\n\\n\\ndef task_func(articles, timezone):\\n    \\\"\\\"\\\"\\n    Analyze the publication times of a list of articles: \\n    1) Convert 'published_time' to a specified timezone\\n    2) Group articles by 'category'\\n    3) For each category, calculate the count, mean, min, max publication times only considering the hour.\\n\\n    Parameters:\\n    articles (list): A list of dictionaries where each dictionary represents \\n    an article with keys 'title', 'title_url', 'id', 'category', and 'published_time' (in UTC).\\n    timezone (str): The string representation of the timezone to which the 'published_time' should be converted.\\n\\n    Returns:\\n    DataFrame: A pandas DataFrame with the count, mean, min, max publication hour for each category.\\n               The category is the index of the DataFrame.\\n\\n    Raises:\\n    ValueError: If dictionary keys do not match the requirements.\\n    TypeError: If articles is not a list of dictionaries. \\n    ValueError: If an empty list is passed as articles.\\n\\n    Requirements:\\n    - pandas\\n    - pytz\\n\\n    Example:\\n    >>> articles = [{'title': 'Apple News', 'title_url': 'Apple_News', 'id': 2, 'category': 'Technology', 'published_time': datetime(2023, 6, 15, 12, 0, 0, tzinfo=pytz.UTC)},\\n    ...             {'title': 'New York Times', 'title_url': 'New_York_Times', 'id': 4, 'category': 'Sports', 'published_time': datetime(2023, 6, 16, 23, 0, 0, tzinfo=pytz.UTC)},\\n    ...             {'title': 'USA Today', 'title_url': 'USA_Today', 'id': 6, 'category': 'Health', 'published_time': datetime(2023, 6, 17, 7, 0, 0, tzinfo=pytz.UTC)}]\\n    >>> analysis_df = task_func(articles, 'America/New_York')\\n    >>> print(analysis_df)\\n                count  mean  min  max\\n    category                         \\n    Health          1   3.0    3    3\\n    Sports          1  19.0   19   19\\n    Technology      1   8.0    8    8\\n    \\\"\\\"\\\"\\n\",\"entry_point\":\"task_func\",\"instruct_prompt\":\"Analyze the publication times of a list of articles: 1) Convert 'published_time' to a specified timezone 2) Group articles by 'category' 3) For each category, calculate the count, mean, min, max publication times only considering the hour.\\nThe function should raise the exception for: ValueError: If dictionary keys do not match the requirements. TypeError: If articles is not a list of dictionaries. ValueError: If an empty list is passed as articles.\\nThe function should output with:\\n    DataFrame: A pandas DataFrame with the count, mean, min, max publication hour for each category.\\n    The category is the index of the DataFrame.\\nYou should write self-contained code starting with:\\n```\\nimport pandas as pd\\nimport pytz\\ndef task_func(articles, timezone):\\n```\",\"libs\":\"['pytz', 'pandas']\"}","display_format":"code","language":"","answer_status":"published","assets":[],"source_url":"https://bigcode-bench.github.io/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}