{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"omni-math","formal_name":"Omni-MATH","introduction":"Omni-MATH evaluates mathematical reasoning on Olympiad-level problems. Its official dataset contains 4,428 problems accompanied by domain and difficulty information.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/KbsdJames/Omni-MATH","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cd9366cc-313f-59e3-a2a6-7ff5a5f1d0c5","task_key":"test--cd9366cc-313f-59e3-a2a6-7ff5a5f1d0c5","task_revision_id":"1","upstream_id":"","short_description":"A box contains twelve balls, each of a different color. Every minute, Randall…","config":"","split":"test","body":"{\"problem\":\"A box contains twelve balls, each of a different color. Every minute, Randall randomly draws a ball from the box, notes its color, and then returns it to the box. Consider the following two conditions: (1) Some ball has been drawn at least twelve times (not necessarily consecutively). (2) Every ball has been drawn at least once. What is the probability that condition (1) is met before condition (2)? If the correct answer is $C$ and your answer is $A$, you get $\\\\max \\\\left(\\\\left\\\\lfloor 30\\\\left(1-\\\\frac{1}{2}\\\\left|\\\\log _{2} C-\\\\log _{2} A\\\\right|\\\\right)\\\\right\\\\rfloor, 0\\\\right)$ points.\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/KbsdJames/Omni-MATH","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}