{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5caf5260-e321-5b96-b9c8-e8678eb63df0","task_key":"fr--test--5caf5260-e321-5b96-b9c8-e8678eb63df0","task_revision_id":"1","upstream_id":"","short_description":"Un réservoir d'eau a une profondeur de 17 pieds le lundi. Le mardi, le réservoir…","config":"fr","split":"test","body":"{\"question\":\"Un réservoir d'eau a une profondeur de 17 pieds le lundi. Le mardi, le réservoir contient 7 pieds d'eau en plus. Le mercredi, la profondeur de l'eau représente les deux tiers de ce qu'elle était le mardi. Quelle est la profondeur de l'eau du réservoir le mercredi ?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}