{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"db8dcec2-e997-50a2-90f8-08bd3869feb1","task_key":"de--test--db8dcec2-e997-50a2-90f8-08bd3869feb1","task_revision_id":"1","upstream_id":"","short_description":"Billy schält und schneidet Kartoffeln als Vorbereitung für die Zubereitung des…","config":"de","split":"test","body":"{\"question\":\"Billy schält und schneidet Kartoffeln als Vorbereitung für die Zubereitung des Kartoffelsalats für seine große Grillparty anlässlich eines Familientreffens. Es ist ein großes Ereignis, also muss er 60 Kartoffeln schaffen. Die Kartoffeln haben ungefähr die gleiche Größe, also braucht es ungefähr gleich viel Zeit, um jede Einzelne zu schälen und zu schneiden. Billy braucht ungefähr eineinhalb Minuten, um eine Kartoffel zu schälen, aber nur ungefähr 5 Sekunden, um sie klein zu schneiden. Wie lange braucht Billy, um die Kartoffelvorbereitung abzuschließen?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}