{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"omni-math","formal_name":"Omni-MATH","introduction":"Omni-MATH evaluates mathematical reasoning on Olympiad-level problems. Its official dataset contains 4,428 problems accompanied by domain and difficulty information.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/KbsdJames/Omni-MATH","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1573f555-4e4f-5860-ad6a-384be00bf796","task_key":"test--1573f555-4e4f-5860-ad6a-384be00bf796","task_revision_id":"1","upstream_id":"","short_description":"Bob Barker went back to school for a PhD in math, and decided to raise the…","config":"","split":"test","body":"{\"problem\":\"Bob Barker went back to school for a PhD in math, and decided to raise the intellectual level of The Price is Right by having contestants guess how many objects exist of a certain type, without going over. The number of points you will get is the percentage of the correct answer, divided by 10, with no points for going over (i.e. a maximum of 10 points). Let's see the first object for our contestants...a table of shape (5,4,3,2,1) is an arrangement of the integers 1 through 15 with five numbers in the top row, four in the next, three in the next, two in the next, and one in the last, such that each row and each column is increasing (from left to right, and top to bottom, respectively). For instance: \\\\begin{tabular}{lcccc} 1 & 2 & 3 & 4 & 5 \\\\\\\\ 6 & 7 & 8 & 9 & \\\\\\\\ 10 & 11 & 12 & & \\\\\\\\ 13 & 14 & & & \\\\\\\\ 15 & & & & \\\\end{tabular} is one table. How many tables are there?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/KbsdJames/Omni-MATH","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}