{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6b263d7c-8bbc-518f-9799-ec5b98f7a4e7","task_key":"fr--test--6b263d7c-8bbc-518f-9799-ec5b98f7a4e7","task_revision_id":"1","upstream_id":"","short_description":"Les sœurs Doubtfire quittent le refuge local pour animaux, avec dans leur…","config":"fr","split":"test","body":"{\"question\":\"Les sœurs Doubtfire quittent le refuge local pour animaux, avec dans leur voiture 7 chatons adoptés. Sur le chemin de retour, elles reçoivent un appel de leur mère qui les informe que leur deux chattes domestiques viennent d'avoir des chatons. Elle dit que Patchy, la première chatte, a eu trois fois le nombre de chatons adoptés, tandis que Trixie, l'autre, en a eu 12. Combien de chatons la famille Doubtfire a-t-elle maintenant ?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}