{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b8e0a2a8-1ff3-5566-b234-29c5c67b9d08","task_key":"sw--test--b8e0a2a8-1ff3-5566-b234-29c5c67b9d08","task_revision_id":"1","upstream_id":"","short_description":"Blake na Kelly wanashindana ili anayeweza kukimbia zaidi kwa dakika 15. Wameamua…","config":"sw","split":"test","body":"{\"question\":\"Blake na Kelly wanashindana ili anayeweza kukimbia zaidi kwa dakika 15. Wameamua kushindana katika uwanja wa kandanda ulio na urefu wa yadi 100. Blake anakimbia kwenda na kurudi mara 15. Kelly anakimbia kwenda na kurudi mara moja, na kisha anaamua kuwa hataki kukimbia kando ya Blake, hivyo anaanza kukimbia kwenda kwa mstari wa yadi 40 kwenda na kurudi. Anafanya hii mara 34. Mshindi alikimbia umbali gani zaidi ya aliyeshindwa?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}