{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2ed474b1-a0df-57e9-8781-a5cc0d47a68e","task_key":"es--test--2ed474b1-a0df-57e9-8781-a5cc0d47a68e","task_revision_id":"1","upstream_id":"","short_description":"Shawnda decide que los niños de su vecindario realmente sacarían provecho de un…","config":"es","split":"test","body":"{\"question\":\"Shawnda decide que los niños de su vecindario realmente sacarían provecho de un servicio de inflado de gomas de bicicletas. Decide que la mejor manera de cobrar el servicio es por goma. Inflar una goma cuesta 25 centavos. El primer día, fueron 5 personas en bicicleta a inflar las dos gomas. Pasaron 3 personas a inflar todas las gomas de sus triciclos. Finalmente, pasó una persona en un monociclo. ¿Cuántos dólares obtuvo Shawnda ese día?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}