{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bb65c8b9-9dc2-5c19-b9f7-37eea431b5bb","task_key":"es--test--bb65c8b9-9dc2-5c19-b9f7-37eea431b5bb","task_revision_id":"1","upstream_id":"","short_description":"Henry está preparando galletas para una competencia local de repostería. Quiere…","config":"es","split":"test","body":"{\"question\":\"Henry está preparando galletas para una competencia local de repostería. Quiere hacer dos veces más que las que hizo el año pasado. Cuando termina de hornear, se da cuenta de que en realidad horneó 15 galletas más de las que quería. Cuando las pone a enfriar, descarta 5 de las galletas y ahora tiene un total de 110 galletas. ¿Cuántas galletas horneó Henry el año pasado?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}