{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"812e517a-3058-5840-af91-565c1f948a46","task_key":"fr--test--812e517a-3058-5840-af91-565c1f948a46","task_revision_id":"1","upstream_id":"","short_description":"Sandra, la fleuriste du coin, est très mécontente de la livraison incomplète…","config":"fr","split":"test","body":"{\"question\":\"Sandra, la fleuriste du coin, est très mécontente de la livraison incomplète effectuée par Fred. Sandra avait commandé quatre fois plus de roses rouges que d'œillets blancs. Elle avait également commandé 200 lys de calla roses, soit cinq fois la quantité d'œillets blancs. Sandra a menacé de changer de fournisseur si les roses rouges manquantes ne sont pas livrées avant 17 heures. Pour garder Sandra comme cliente, combien de roses rouges Fred doit-il livrer avant 17 heures ?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}