{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ad92a85b-ac2a-5643-a449-9923d9b06893","task_key":"fr--test--ad92a85b-ac2a-5643-a449-9923d9b06893","task_revision_id":"1","upstream_id":"","short_description":"Deux trains partent de San Rafael au même moment. Ils se dirigent d'abord vers…","config":"fr","split":"test","body":"{\"question\":\"Deux trains partent de San Rafael au même moment. Ils se dirigent d'abord vers l'ouest et parcourent tous les deux 80 miles. Le jour suivant, ils voyagent vers le nord, couvrant 150 miles. Quelle est la distance parcourue par chaque train au cours de ces deux jours ?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}