{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"27ed52e4-8da5-58c6-a86c-1ac922422a89","task_key":"es--test--27ed52e4-8da5-58c6-a86c-1ac922422a89","task_revision_id":"1","upstream_id":"","short_description":"Un tanque de agua se llena con 120 litros de agua. Celine usó 90 litros de agua…","config":"es","split":"test","body":"{\"question\":\"Un tanque de agua se llena con 120 litros de agua. Celine usó 90 litros de agua del tanque para regar su pequeño jardín. Luego, pudo recolectar agua de lluvia, que era el doble de la cantidad que había quedado. ¿Cuántos litros de agua hay en el tanque ahora?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}