{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5ce5cf3b-63fb-5ab7-8087-e1e1ce87ac74","task_key":"fr--test--5ce5cf3b-63fb-5ab7-8087-e1e1ce87ac74","task_revision_id":"1","upstream_id":"","short_description":"Russell travaille dans une animalerie et distribue de la paille aux rongeurs.…","config":"fr","split":"test","body":"{\"question\":\"Russell travaille dans une animalerie et distribue de la paille aux rongeurs. Les rats sont répartis dans 3 cages par groupes de taille égale et chaque rat reçoit 6 morceaux de paille. Il y a 10 cages de hamsters. Chacun d'eux est seul dans sa cage et reçoit 5 morceaux de paille. Il y a aussi un enclos de lapins où l'on distribue 20 morceaux de paille. Aucune paille n'est utilisée ailleurs dans le magasin. Si 160 morceaux de paille ont été distribués aux petits rongeurs, combien de rats y a-t-il dans chaque cage ?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}