{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"scicode","formal_name":"SciCode","introduction":"SciCode evaluates the ability to solve scientific research problems through code. Problems are decomposed into subproblems; this dev import preserves the relationships between 15 parent problems and 50 subproblems.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/SciCode1/SciCode","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"f85e0cd6-6084-5999-8cb4-7c8b2022d282","task_key":"dev--49c68bb1-a088-53d9-a366-0885b5d1b63b--70~2e5","task_revision_id":"3","upstream_id":"70.5","short_description":"Write a function to compute the \"star product\" $(hh)_i = d_{ijk}h^jh^k$ for a…","config":"","split":"dev","body":"{\"step_background\":\"\",\"step_description_prompt\":\"Write a function to compute the \\\"star product\\\" $(hh)_i = d_{ijk}h^jh^k$ for a given input $i$, where $h$ are the expansion coefficients defined in prompt () and $d_{ijk}$ is the tensor defined in prompt (). Sum over all possible pairs of indices $j$ and $k$ from 1 to 8. Possible input index $i$ also goes from 1 to 8.\"}","display_format":"scicode-step","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/SciCode1/SciCode","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}