{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d6db3a62-5f23-5c65-a815-b41ff6ad77fb","task_key":"es--test--d6db3a62-5f23-5c65-a815-b41ff6ad77fb","task_revision_id":"1","upstream_id":"","short_description":"Un banco de niebla ingresa desde el océano para cubrir una ciudad. Le lleva 10…","config":"es","split":"test","body":"{\"question\":\"Un banco de niebla ingresa desde el océano para cubrir una ciudad. Le lleva 10 minutos cubrir 3 millas de la ciudad. Si la ciudad se extiende 42 millas desde la orilla del mar hasta el margen interior opuesto, ¿cuántos minutos tardará el banco de niebla en cubrir toda la ciudad?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}