{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d6b442a7-9021-5223-a4c4-a228cb6ac256","task_key":"de--test--d6b442a7-9021-5223-a4c4-a228cb6ac256","task_revision_id":"1","upstream_id":"","short_description":"Blake und Kelly veranstalten einen Wettkampf, um zu sehen, wer in 15 Minuten…","config":"de","split":"test","body":"{\"question\":\"Blake und Kelly veranstalten einen Wettkampf, um zu sehen, wer in 15 Minuten weiter laufen kann. Sie beschließen, es auf einem Footballfeld zu tun, das 100 Yards lang ist. Blake läuft 15 Mal hin und zurück. Kelly läuft einmal hin und zurück und beschließt dann, dass sie nicht neben Blake laufen will; also beginnt sie, zur 40-Yard-Linie und zurück zu laufen. Sie tut dies 34 Mal. Wie viel läuft der Gewinner weiter als der Verlierer?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}