{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"eb5ef59a-86e5-5e00-b56c-4d64adf18182","task_key":"es--test--eb5ef59a-86e5-5e00-b56c-4d64adf18182","task_revision_id":"1","upstream_id":"","short_description":"Las hermanas Doubtfire están conduciendo a su casa con 7 gatitos que adoptaron…","config":"es","split":"test","body":"{\"question\":\"Las hermanas Doubtfire están conduciendo a su casa con 7 gatitos que adoptaron en el refugio de animales local cuando su madre las llama para avisarles que sus dos gatas domésticas acaban de tener gatitos. Les dice que Patchy, la primera gata, ha tenido tres veces la cantidad de gatitos adoptados, mientras que Trixie, la otra gata, ha tenido 12. ¿Cuántos gatitos tiene ahora la familia Doubtfire?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}