{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"729a548f-3520-5e49-b92d-772083d1c599","task_key":"es--test--729a548f-3520-5e49-b92d-772083d1c599","task_revision_id":"1","upstream_id":"","short_description":"Henry hizo dos paradas durante su viaje en bicicleta de 60 millas. Primero paró…","config":"es","split":"test","body":"{\"question\":\"Henry hizo dos paradas durante su viaje en bicicleta de 60 millas. Primero paró después de 20 millas. Su segunda parada fue 15 millas antes de terminar el viaje. ¿Cuántas millas recorrió entre la primera y la segunda parada?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}