{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"46b98f9d-205a-50a1-b045-d7f015b6a6d2","task_key":"de--test--46b98f9d-205a-50a1-b045-d7f015b6a6d2","task_revision_id":"1","upstream_id":"","short_description":"Dave kaufte eine große Packung Pommes frites und aß vierzehn, bevor eine…","config":"de","split":"test","body":"{\"question\":\"Dave kaufte eine große Packung Pommes frites und aß vierzehn, bevor eine hungrige Möwe die Packung aus seiner Hand klaute. Als die Möwe landete, verschlang sie halb so viele Pommes frites, wie Dave gegessen hatte. Dann drängelten sie drei Tauben von dem Essen weg, und jede Taube aß drei Pommes frites. Später klaute ein Waschbär zwei Drittel der verbleibenden Pommes frites. Ameisen trugen ein letztes Pommes frite davon und ließen fünf zurück. Wie viel Pommes frites waren in der Packung, als Dave sie kaufte?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}