{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2577fd53-7a98-5c65-98d7-c4d7a66bd43c","task_key":"es--test--2577fd53-7a98-5c65-98d7-c4d7a66bd43c","task_revision_id":"1","upstream_id":"","short_description":"Sandra, la florista de la esquina, está muy desconforme con la entrega…","config":"es","split":"test","body":"{\"question\":\"Sandra, la florista de la esquina, está muy desconforme con la entrega incompleta del pedido de Fred. Sandra había pedido cuatro veces más rosas rojas que claveles blancos. También pidió 200 calas rosas, que eran cinco veces la cantidad de claveles blancos. Sandra amenazó con cambiar de proveedor si no recibía las rosas rojas que faltaban antes de las 5 p. m. ¿Cuántas rosas rojas debe entregar Fred antes de las 5 p. m. para conservar el negocio de Sandra?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}