{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"omni-math","formal_name":"Omni-MATH","introduction":"Omni-MATH evaluates mathematical reasoning on Olympiad-level problems. Its official dataset contains 4,428 problems accompanied by domain and difficulty information.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/KbsdJames/Omni-MATH","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e070554b-1984-54a2-96e9-d446a25bc47a","task_key":"test--e070554b-1984-54a2-96e9-d446a25bc47a","task_revision_id":"1","upstream_id":"","short_description":"You have a length of string and 7 beads in the 7 colors of the rainbow. You…","config":"","split":"test","body":"{\"problem\":\"You have a length of string and 7 beads in the 7 colors of the rainbow. You place the beads on the string as follows - you randomly pick a bead that you haven't used yet, then randomly add it to either the left end or the right end of the string. What is the probability that, at the end, the colors of the beads are the colors of the rainbow in order? (The string cannot be flipped, so the red bead must appear on the left side and the violet bead on the right side.)\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/KbsdJames/Omni-MATH","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}