{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"omni-math","formal_name":"Omni-MATH","introduction":"Omni-MATH evaluates mathematical reasoning on Olympiad-level problems. Its official dataset contains 4,428 problems accompanied by domain and difficulty information.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/KbsdJames/Omni-MATH","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"debcb5d3-6fcd-590b-9b34-72b07ae41e7d","task_key":"test--debcb5d3-6fcd-590b-9b34-72b07ae41e7d","task_revision_id":"1","upstream_id":"","short_description":"A standard $n$-sided die has $n$ sides labeled 1 to $n$. Luis, Luke, and Sean…","config":"","split":"test","body":"{\"problem\":\"A standard $n$-sided die has $n$ sides labeled 1 to $n$. Luis, Luke, and Sean play a game in which they roll a fair standard 4-sided die, a fair standard 6-sided die, and a fair standard 8-sided die, respectively. They lose the game if Luis's roll is less than Luke's roll, and Luke's roll is less than Sean's roll. Compute the probability that they lose the game.\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/KbsdJames/Omni-MATH","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}