{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"af07bd6b-268b-5d94-9aa1-9b461ca0aba7","task_key":"de--test--af07bd6b-268b-5d94-9aa1-9b461ca0aba7","task_revision_id":"1","upstream_id":"","short_description":"Russell arbeitet in einer Tierhandlung und verteilt gerade Stroh unter den…","config":"de","split":"test","body":"{\"question\":\"Russell arbeitet in einer Tierhandlung und verteilt gerade Stroh unter den Nagetieren. Die Ratten werden in 3 Käfigen in gleich großen Gruppen gehalten und jeder Ratte 6 Strohhalme gegeben. Es gibt 10 Käfige von Hamstern, die allein gehalten werden, und jedem Hamster werden 5 Strohhalme gegeben. Es gibt auch einen Hasenstall, in dem 20 Strohhalme unter den Hasen verteilt werden. Überall sonst in dem Laden wird kein Stroh verteilt. Wenn 160 Strohhalme unter den kleinen Nagetieren verteil wurden, wie viele Ratten sind dann in jedem Käfig?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}