{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0cdbcbe3-c5f3-5fd4-a9b4-c8ff41b94cab","task_key":"es--test--0cdbcbe3-c5f3-5fd4-a9b4-c8ff41b94cab","task_revision_id":"1","upstream_id":"","short_description":"Sara quiere comprarse una chaqueta y 2 pares de zapatos nuevos. La chaqueta que…","config":"es","split":"test","body":"{\"question\":\"Sara quiere comprarse una chaqueta y 2 pares de zapatos nuevos. La chaqueta que quiere cuesta $30 y cada par de zapatos cuesta $20. Sara cuida a los niños de su vecino 4 veces y gana $5 cada vez que los cuida. Sus padres le pagan $4 cada vez que corta el césped. Si Sara ya tenía $10 ahorrados antes de comenzar a cuidar niños, ¿cuántas veces deberá cortar el césped antes de poder comprarse la chaqueta y los zapatos?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}