{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fa1c19f1-4d4b-58b5-853e-6578b61a7430","task_key":"fr--test--fa1c19f1-4d4b-58b5-853e-6578b61a7430","task_revision_id":"1","upstream_id":"","short_description":"Lorsque Freda fait cuire des tomates en conserve pour en faire de la sauce, ces…","config":"fr","split":"test","body":"{\"question\":\"Lorsque Freda fait cuire des tomates en conserve pour en faire de la sauce, ces dernières perdent la moitié de leur volume. Elle utilise des boîtes de 16 onces qui contiennent chacune trois tomates. La dernière préparation de sauce tomate de Freda a permis d'obtenir 32 onces de sauce. Combien de tomates Freda a-t-elle utilisées ?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}