{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8944e711-7e48-5938-84a9-d7af90bce1b7","task_key":"es--test--8944e711-7e48-5938-84a9-d7af90bce1b7","task_revision_id":"1","upstream_id":"","short_description":"El bote de Julia comenzó a tener filtraciones mientras estaba en el lago.…","config":"es","split":"test","body":"{\"question\":\"El bote de Julia comenzó a tener filtraciones mientras estaba en el lago. Entraban dos litros de agua por cada diez pies que remaba hacia la orilla. Le llevó dieciséis segundos remar veinte pies. La orilla estaba a 64 segundos de distancia. ¿Cuánta agua tenía el bote cuando Julia llegó a la orilla?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}