{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6ca70697-298b-5e01-a61d-1ffa7706c49e","task_key":"es--test--6ca70697-298b-5e01-a61d-1ffa7706c49e","task_revision_id":"1","upstream_id":"","short_description":"Dave compró un paquete grande de patatas fritas y comió catorce antes de que una…","config":"es","split":"test","body":"{\"question\":\"Dave compró un paquete grande de patatas fritas y comió catorce antes de que una gaviota hambrienta le robara el paquete de las manos. Cuando la gaviota aterrizó, engulló la mitad de la cantidad de patatas fritas que había comido Dave. Luego, tres palomas lo intimidaron para que se alejara de la comida, y cada paloma comió tres patatas. Más tarde, un mapache robó dos tercios de las patatas que quedaban. Las hormigas se llevaron una última patata, dejando cinco. ¿Cuántas patatas fritas había en el paquete que compró Dave?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}