{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"bigcodebench","formal_name":"BigCodeBench","introduction":"BigCodeBench poses 1,140 function-level tasks drawn across 139 libraries. It tests whether a model can compose several real APIs correctly rather than write one self-contained function.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://bigcode-bench.github.io/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"649f0899-671c-5ade-b1d5-d6d731cbcd6d","task_key":"default--v0~2e1~2e0~5fhf--649f0899-671c-5ade-b1d5-d6d731cbcd6d","task_revision_id":"1","upstream_id":"","short_description":"BigCodeBench v0.1.0_hf 649f0899-671c-5ade-b1d5-d6d731cbcd6d","config":"default","split":"v0.1.0_hf","body":"{\"code_prompt\":\"import subprocess\\nimport pandas as pd\\ndef task_func(script_path, output_file_path):\\n\",\"complete_prompt\":\"import subprocess\\nimport pandas as pd\\n\\ndef task_func(script_path, output_file_path):\\n    \\\"\\\"\\\"\\n    Executes a script to produce a CSV, reads the CSV, and plots a bar graph from the data.\\n\\n    This function runs the provided script, which should generate a CSV file at the specified output path.\\n    The CSV must have exactly two columns. It then reads this CSV into a DataFrame and plots a bar graph,\\n    setting the first column as the x-axis labels and the second column as the bar heights.\\n    It will raise ValueError if the script fails to execute, or if the produced CSV is not valid.\\n\\n    Parameters:\\n    - script_path (str): Path to the script to be executed.\\n    - output_file_path (str): Path where the script outputs the CSV.\\n\\n    Returns:\\n    - df (pd.DataFrame): DataFrame containing the data from the CSV.\\n    - ax (matplotlib.axes._axes.Axes): Axes object of the plotted bar graph.\\n\\n    Raises:\\n    - ValueError: If the script fails to execute, the CSV is invalid, or the CSV does not contain exactly 2 columns.\\n    \\n    Requirements:\\n    - pandas\\n    - subprocess\\n\\n    Examples:\\n    >>> df, ax = task_func(\\\"generate_data.sh\\\", \\\"data.csv\\\")\\n    >>> type(df)\\n    <class 'pandas.core.frame.DataFrame'>\\n    >>> type(ax)\\n    <class 'matplotlib.axes._axes.Axes'>\\n    \\\"\\\"\\\"\\n\",\"entry_point\":\"task_func\",\"instruct_prompt\":\"Executes a script to produce a CSV, reads the CSV, and plots a bar graph from the data. This function runs the provided script, which should generate a CSV file at the specified output path. The CSV must have exactly two columns. It then reads this CSV into a DataFrame and plots a bar graph, setting the first column as the x-axis labels and the second column as the bar heights. It will raise ValueError if the script fails to execute, or if the produced CSV is not valid.\\nThe function should raise the exception for: ValueError: If the script fails to execute, the CSV is invalid, or the CSV does not contain exactly 2 columns.\\nThe function should output with:\\n    df (pd.DataFrame): DataFrame containing the data from the CSV.\\n    ax (matplotlib.axes._axes.Axes): Axes object of the plotted bar graph.\\nYou should write self-contained code starting with:\\n```\\nimport subprocess\\nimport pandas as pd\\ndef task_func(script_path, output_file_path):\\n```\",\"libs\":\"['subprocess', 'pandas']\"}","display_format":"code","language":"","answer_status":"published","assets":[],"source_url":"https://bigcode-bench.github.io/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}