{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"math","formal_name":"MATH","introduction":"MATH organises 12,500 high-school competition problems into seven subjects and five difficulty levels, each with a full worked solution. It underlies much of the later mathematics evaluation work; this catalogue imports the full test split: 5,000 problems across all seven subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/math","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a0273517-c0ff-5390-ada8-c37c4b4c8ede","task_key":"prealgebra--test--a0273517-c0ff-5390-ada8-c37c4b4c8ede","task_revision_id":"1","upstream_id":"","short_description":"You can get anything you want at Alberto's restaurant, as long as what you want…","config":"prealgebra","split":"test","body":"{\"level\":\"Level 4\",\"problem\":\"You can get anything you want at Alberto's restaurant, as long as what you want is a sandwich with two different fillings. There are nine fillings to choose from (turkey, ham, roast beef, cheese, tomatoes, peppers, sprouts, oranges, and licorice). How many different sandwiches can you order (including the ones that nobody in their right mind would order)?\",\"type\":\"Prealgebra\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/math","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}