{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"df006e12-0493-581d-89ea-a491bc56f6e4","task_key":"sw--test--df006e12-0493-581d-89ea-a491bc56f6e4","task_revision_id":"1","upstream_id":"","short_description":"Zimwi mkubwa, Perg, alikaa sehemu ya juu zaidi ya mlima Farbo, akiwa na hasira…","config":"sw","split":"test","body":"{\"question\":\"Zimwi mkubwa, Perg, alikaa sehemu ya juu zaidi ya mlima Farbo, akiwa na hasira zaidi kwa kitu chochote ndani ya umbali wa futi 1000. Polly aliweza kutupa mkuki wa dhahabu, silaha pekee inayojulikana inayoweza kumfikia zimwi huyo, kwa umbali wa futi 400, vizuri ndani ya ufikiaji wa miale ya zimwi. Lakini Polly aliposhikilia johari, aliweza kutupa mkuki huo mara tatu zaidi ya umbali wa wakati ambapo hajashikilia johari. Akishikilia johari, ni umbali gani zaidi usioweza kufikiwa na miale ya zimwi ambao Polly angesimama na bado kuweza kumgonga zimwi huyo kwa mkuki wa dhahabu?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}