{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4a11165d-3136-56b1-871c-e38538596e6e","task_key":"es--test--4a11165d-3136-56b1-871c-e38538596e6e","task_revision_id":"1","upstream_id":"","short_description":"Candice puso 80 notas adhesivas en su bolso antes de irse a su trabajo en la…","config":"es","split":"test","body":"{\"question\":\"Candice puso 80 notas adhesivas en su bolso antes de irse a su trabajo en la cafetería. En el camino, se detuvo en la tienda y compró un paquete de notas adhesivas. En el trabajo, colocó una sola nota adhesiva en cada una de las 220 tazas de café diferentes. Si le quedan 23 notas adhesivas en total, ¿cuántas notas adhesivas había en el paquete que compró?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}