{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"math","formal_name":"MATH","introduction":"MATH organises 12,500 high-school competition problems into seven subjects and five difficulty levels, each with a full worked solution. It underlies much of the later mathematics evaluation work; this catalogue imports the full test split: 5,000 problems across all seven subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/math","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"98e22fbd-478e-5cdd-b033-48387c147bcf","task_key":"counting~5fand~5fprobability--test--98e22fbd-478e-5cdd-b033-48387c147bcf","task_revision_id":"1","upstream_id":"","short_description":"A large, regular hexagon is drawn on the ground, and a man stands at one of the…","config":"counting_and_probability","split":"test","body":"{\"level\":\"Level 5\",\"problem\":\"A large, regular hexagon is drawn on the ground, and a man stands at one of the vertices.  The man flips a coin.  If the coin lands heads, he walks counterclockwise along the edge of the hexagon until reaching the next nearest vertex.  If the coin lands tails, he walks clockwise around the hexagon until reaching another vertex.  Once there, he repeats the process.  The man flips the coin a total of six times.  What is the probability that the man is standing where he started when he is finished?\",\"type\":\"Counting & Probability\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/math","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}