{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"scicode","formal_name":"SciCode","introduction":"SciCode evaluates the ability to solve scientific research problems through code. Problems are decomposed into subproblems; this dev import preserves the relationships between 15 parent problems and 50 subproblems.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/SciCode1/SciCode","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"fdf53356-9503-57f4-8a75-ea7ae67ec45f","task_key":"dev--49c68bb1-a088-53d9-a366-0885b5d1b63b--70~2e4","task_revision_id":"3","upstream_id":"70.4","short_description":"Write a function to compute the tensor $d_{ijk}$ which is defined as $d_{i j…","config":"","split":"dev","body":"{\"step_background\":\"\",\"step_description_prompt\":\"Write a function to compute the tensor $d_{ijk}$ which is defined as $d_{i j k}=\\\\frac{1}{4} \\\\operatorname{Tr}\\\\left(\\\\left\\\\{\\\\lambda_{i}, \\\\lambda_{j}\\\\right\\\\} \\\\lambda_{k}\\\\right)$. The bracket represents the anticomumator and the $\\\\lambda$s are the Gell-Mann matrices. Consider all possible commutations of the indices $i, j, $and $k$. Consider indices going from 1 to 8. Return only the real part of the results.\"}","display_format":"scicode-step","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/SciCode1/SciCode","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}