{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8d379fda-5080-5d3f-8fcb-1424ed2aeed4","task_key":"fr--test--8d379fda-5080-5d3f-8fcb-1424ed2aeed4","task_revision_id":"1","upstream_id":"","short_description":"Ram utilise de nombreux stylos. Il a découvert qu'il pouvait économiser de…","config":"fr","split":"test","body":"{\"question\":\"Ram utilise de nombreux stylos. Il a découvert qu'il pouvait économiser de l'argent en mélangeant l'encre de cinq stylos vides pour fabriquer un stylo plein. S'il achète 25 stylos qu'il utilise pour fabriquer de nouveaux stylos lorsque l'encre est épuisée, combien de stylos obtiendra-t-il au total ?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}