{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"22879f1c-84c0-5820-80a2-32d6aea5cabb","task_key":"fr--test--22879f1c-84c0-5820-80a2-32d6aea5cabb","task_revision_id":"1","upstream_id":"","short_description":"Jill gagne 20 $ de l'heure en tant qu'enseignante et 30 $ comme entraineuse de…","config":"fr","split":"test","body":"{\"question\":\"Jill gagne 20 $ de l'heure en tant qu'enseignante et 30 $ comme entraineuse de majorettes. Si elle travaille 35 heures par semaine en tant qu'enseignante, 15 heures par semaine comme entraineuse et 50 semaines par an, quel est son salaire annuel ?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}