{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3121bc7a-05a2-57c6-bd60-f5f374906123","task_key":"es--test--3121bc7a-05a2-57c6-bd60-f5f374906123","task_revision_id":"1","upstream_id":"","short_description":"Jerry tiene dos piscinas, ambas con fugas que las van vaciando a una velocidad…","config":"es","split":"test","body":"{\"question\":\"Jerry tiene dos piscinas, ambas con fugas que las van vaciando a una velocidad de 4 galones/minuto. Hace 4 minutos, la piscina grande tenía la misma cantidad de agua que la piscina pequeña. Ahora, la piscina grande tiene cuatro veces la cantidad de agua de la piscina chica. ¿Qué cantidad de agua tiene ahora la piscina chica?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}