{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"568fdedb-9790-5980-bee7-b9e3bef0bb62","task_key":"es--test--568fdedb-9790-5980-bee7-b9e3bef0bb62","task_revision_id":"1","upstream_id":"","short_description":"Jerome tenía 4 amigos que venían a visitarlo un día determinado. El primer amigo…","config":"es","split":"test","body":"{\"question\":\"Jerome tenía 4 amigos que venían a visitarlo un día determinado. El primer amigo tocó el timbre 20 veces antes de que Jerome abriera, el segundo amigo tocó el timbre 1/4 de veces más que el primero. El tercer amigo tocó el timbre 10 veces más que el cuarto. Si el cuarto amigo tocó el timbre 60 veces, ¿cuántas veces sonó el timbre?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}