{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fae85bb4-e3d0-54ba-aca2-cea5b84354f9","task_key":"es--test--fae85bb4-e3d0-54ba-aca2-cea5b84354f9","task_revision_id":"1","upstream_id":"","short_description":"Julia estaba preparando una cena en su casa en la que pensaba servir estofado.…","config":"es","split":"test","body":"{\"question\":\"Julia estaba preparando una cena en su casa en la que pensaba servir estofado. Se dio cuenta de que no tenía cucharas de plástico, entonces compró un nuevo paquete de cucharas. Después, su marido también compró un paquete de 5 cucharas nuevas y se lo dio a Julia. Mientras Julia preparaba el estofado, usó tres de las cucharas para probar el estofado. Más tarde, cuando fue a poner la mesa, tenía un total de 12 cucharas. ¿Cuántas cucharas había en el paquete que compró Julia?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}