{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"77a59e80-5f44-5692-8063-7c9c1d641421","task_key":"fr--test--77a59e80-5f44-5692-8063-7c9c1d641421","task_revision_id":"1","upstream_id":"","short_description":"Blake et Kelly s'affrontent pour savoir qui peut courir le plus en 15 minutes.…","config":"fr","split":"test","body":"{\"question\":\"Blake et Kelly s'affrontent pour savoir qui peut courir le plus en 15 minutes. Ils décident de le faire sur un terrain de football de 100 yards de long. Blake fait 15 allers-retours. Kelly fait un aller-retour, puis décide qu'elle ne veut pas courir aux côtés de Blake. Elle commence donc à faire l'aller-retour en se limitant à la ligne des 40 yards. Elle le fait 34 fois. Combien de yards le gagnant a-t-il couru de plus que le perdant ?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}