{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d128267b-a57e-56cf-a633-b3cb9cd421fe","task_key":"fr--test--d128267b-a57e-56cf-a633-b3cb9cd421fe","task_revision_id":"1","upstream_id":"","short_description":"Sue habite un quartier où règne la bonne humeur. Au cours d'un certain week-end,…","config":"fr","split":"test","body":"{\"question\":\"Sue habite un quartier où règne la bonne humeur. Au cours d'un certain week-end, les voisins ont décidé de lui faire une farce. Le vendredi matin, ils ont placé 18 flamants roses en plastique dans son jardin. Le samedi matin, les voisins ont repris un tiers des flamants roses qu'ils ont peints en blanc et replacés dans le jardin de Sue. Puis, le dimanche matin, ils ont ajouté 18 autres flamants roses en plastique à la collection. À midi, le dimanche, quelle quantité de flamants roses en plastique y avait-il de plus que celle des flamants blancs ?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}