{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"aa596323-3ab2-53e6-a9f4-d8d01f5854cd","task_key":"es--test--aa596323-3ab2-53e6-a9f4-d8d01f5854cd","task_revision_id":"1","upstream_id":"","short_description":"Luke pasa el tiempo en la playa construyendo castillos de arena. Con el tiempo…","config":"es","split":"test","body":"{\"question\":\"Luke pasa el tiempo en la playa construyendo castillos de arena. Con el tiempo advierte que cada planta de un castillo de arena tendrá la mitad de la superficie en pies cuadrados que el nivel de abajo. Si construye un castillo de arena de 4 plantas, en el que la planta superior tiene una superficie de 16 pies cuadrados, ¿cuál será la superficie en pies cuadrados promedio de una planta?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}