{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5ca8bb75-710d-5ae0-8924-85c1e9b03ac3","task_key":"es--test--5ca8bb75-710d-5ae0-8924-85c1e9b03ac3","task_revision_id":"1","upstream_id":"","short_description":"El teléfono de Jamal puede guardar 6 veces más fotografías que el teléfono de…","config":"es","split":"test","body":"{\"question\":\"El teléfono de Jamal puede guardar 6 veces más fotografías que el teléfono de Brittany. La cantidad máxima de fotografías que puede guardar el teléfono de Brittany es 50 veces más que la cantidad de aves que hay en la fotografía que Jamal tomó de los patos en el zoológico. Si el teléfono de Jamal puede guardar 1800 fotografías, ¿cuántos patos se pueden ver en la fotografía que Jamal tomó de los patos en el zoológico?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}