{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"omni-math","formal_name":"Omni-MATH","introduction":"Omni-MATH evaluates mathematical reasoning on Olympiad-level problems. Its official dataset contains 4,428 problems accompanied by domain and difficulty information.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/KbsdJames/Omni-MATH","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bf6416cf-c010-55a3-9234-d8954014be79","task_key":"test--bf6416cf-c010-55a3-9234-d8954014be79","task_revision_id":"1","upstream_id":"","short_description":"A box contains three balls, each of a different color. Every minute, Randall…","config":"","split":"test","body":"{\"problem\":\"A box contains three balls, each of a different color. Every minute, Randall randomly draws a ball from the box, notes its color, and then returns it to the box. Consider the following two conditions: (1) Some ball has been drawn at least three times (not necessarily consecutively). (2) Every ball has been drawn at least once. What is the probability that condition (1) is met before condition (2)?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/KbsdJames/Omni-MATH","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}