{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"math","formal_name":"MATH","introduction":"MATH organises 12,500 high-school competition problems into seven subjects and five difficulty levels, each with a full worked solution. It underlies much of the later mathematics evaluation work; this catalogue imports the full test split: 5,000 problems across all seven subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/math","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"65631bfb-943f-5766-883b-b42b34b0bbcb","task_key":"counting~5fand~5fprobability--test--65631bfb-943f-5766-883b-b42b34b0bbcb","task_revision_id":"1","upstream_id":"","short_description":"Markov plays a game for three turns. On each turn, he either rolls a fair, six…","config":"counting_and_probability","split":"test","body":"{\"level\":\"Level 4\",\"problem\":\"Markov plays a game for three turns. On each turn, he either rolls a fair, six sided die or flips a fair coin. If he rolls a 1 or 2 on the die, he will switch to the coin on the next turn, and if he flips a tails on the coin, he will switch to the die on the next turn. If Markov starts by rolling the die, what is the probability that he will flip the coin on the third turn?\",\"type\":\"Counting & Probability\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/math","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}