{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"math","formal_name":"MATH","introduction":"MATH organises 12,500 high-school competition problems into seven subjects and five difficulty levels, each with a full worked solution. It underlies much of the later mathematics evaluation work; this catalogue imports the full test split: 5,000 problems across all seven subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/math","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"40c22751-68a8-59b0-a641-8e175fbf74d5","task_key":"counting~5fand~5fprobability--test--40c22751-68a8-59b0-a641-8e175fbf74d5","task_revision_id":"1","upstream_id":"","short_description":"Each of five, standard, six-sided dice is rolled once. Two of the dice come up…","config":"counting_and_probability","split":"test","body":"{\"level\":\"Level 5\",\"problem\":\"Each of five, standard, six-sided dice is rolled once. Two of the dice come up the same, but the other three are all different from those two and different from each other. The pair is set aside, and the other three dice are re-rolled. The dice are said to show a \\\"full house\\\" if three of the dice show the same value and the other two show the same value (and potentially, but not necessarily, all five dice show the same value). What is the probability that after the second set of rolls, the dice show a full house?\",\"type\":\"Counting & Probability\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/math","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}