{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"omni-math","formal_name":"Omni-MATH","introduction":"Omni-MATH evaluates mathematical reasoning on Olympiad-level problems. Its official dataset contains 4,428 problems accompanied by domain and difficulty information.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/KbsdJames/Omni-MATH","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3656713e-51ec-5c77-bf0f-b02b5783c59e","task_key":"test--3656713e-51ec-5c77-bf0f-b02b5783c59e","task_revision_id":"1","upstream_id":"","short_description":"The numbers $2^{0}, 2^{1}, \\cdots, 2^{15}, 2^{16}=65536$ are written on a…","config":"","split":"test","body":"{\"problem\":\"The numbers $2^{0}, 2^{1}, \\\\cdots, 2^{15}, 2^{16}=65536$ are written on a blackboard. You repeatedly take two numbers on the blackboard, subtract one from the other, erase them both, and write the result of the subtraction on the blackboard. What is the largest possible number that can remain on the blackboard when there is only one number left?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/KbsdJames/Omni-MATH","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}