{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3453f7cc-5798-57b0-aba5-90da1ee5ecfc","task_key":"de--test--3453f7cc-5798-57b0-aba5-90da1ee5ecfc","task_revision_id":"1","upstream_id":"","short_description":"Sandra, der Blumenladen um die Ecke, ist sehr unzufrieden mit Freds…","config":"de","split":"test","body":"{\"question\":\"Sandra, der Blumenladen um die Ecke, ist sehr unzufrieden mit Freds unvollständiger Lieferung der Bestellung. Sandra hatte vier Mal so viele rote Rosen bestellt wie weiße Nelken. Sie bestellte auch 200 rosa Zimmercalla, die fünf Mal der Anzahl weißer Nelken entsprachen. Sandra drohte damit, den Lieferanten zu wechseln, wenn die fehlenden roten Rosen nicht bis 17 Uhr geliefert würden. Wie viele rote Rosen muss Fred bis 17 Uhr liefern, um Sandras Einkauf zu behalten?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}