{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"34ad566f-6fc0-59a8-a8c3-02bf04e176dd","task_key":"fr--test--34ad566f-6fc0-59a8-a8c3-02bf04e176dd","task_revision_id":"1","upstream_id":"","short_description":"Pour ses 30 ans, Elvira a choisi comme cadeau un nouvel ordinateur avec de…","config":"fr","split":"test","body":"{\"question\":\"Pour ses 30 ans, Elvira a choisi comme cadeau un nouvel ordinateur avec de nombreux accessoires. Elle dispose d'un budget de 1 500 € offert par toute sa famille et pense qu'elle pourra en garder un peu pour s'offrir un vêtement. Elle se rend dans un magasin d'informatique et choisit une appareil qui coûte 1090 € avec un écran, un clavier et une souris. Elle se procure également un scanner de 157 €, un graveur de CD de 74 € et une imprimante de 102 €. Combien d'argent lui restera-t-il pour ses vêtements ?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}