{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0db9eb64-5628-5cfb-aa76-7b33098a2d31","task_key":"es--test--0db9eb64-5628-5cfb-aa76-7b33098a2d31","task_revision_id":"1","upstream_id":"","short_description":"Blake y Kelly están compitiendo para ver quién corre más en 15 minutos. Deciden…","config":"es","split":"test","body":"{\"question\":\"Blake y Kelly están compitiendo para ver quién corre más en 15 minutos. Deciden hacer la competencia en el campo de fútbol americano que tiene 100 yardas de largo. Blake corre de un lado a otro 15 veces. Kelly corre de un lado a otro una vez y después decide que no quiere correr junto a Blake, así que comienza a correr hasta la línea de 40 yardas y vuelve. Lo hace 34 veces. ¿Cuánto más lejos corrió el ganador con respecto al perdedor?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}