{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"math","formal_name":"MATH","introduction":"MATH organises 12,500 high-school competition problems into seven subjects and five difficulty levels, each with a full worked solution. It underlies much of the later mathematics evaluation work; this catalogue imports the full test split: 5,000 problems across all seven subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/math","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7ee054fe-0f4a-594c-a61d-77dc0b85aad5","task_key":"prealgebra--test--7ee054fe-0f4a-594c-a61d-77dc0b85aad5","task_revision_id":"1","upstream_id":"","short_description":"Euclid, Pythagoras, Ptolemy, and Hypatia are playing a game where they all have…","config":"prealgebra","split":"test","body":"{\"level\":\"Level 2\",\"problem\":\"Euclid, Pythagoras, Ptolemy, and Hypatia are playing a game where they all have to think of a number, and then cube that number 20 times. Hypatia doesn't want to cube large numbers, so she chooses the number 1. Euclid thinks the same thing and also chooses the number 1. However, Pythagoras and Ptolemy don't think ahead and Pythagoras chooses 2 and Ptolemy chooses -2. After they finish cubing their numbers (Pythagoras and Ptolemy take a while), all four players write their final numbers on a piece of paper. What is the sum of the numbers they wrote on the piece of paper?\",\"type\":\"Prealgebra\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/math","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}