{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"65baffa9-5b62-5e89-bdf8-f5fcbf7fd2e2","task_key":"sw--test--65baffa9-5b62-5e89-bdf8-f5fcbf7fd2e2","task_revision_id":"1","upstream_id":"","short_description":"Jerome alikuwa na marafiki 4 waliokuja kumtembelea siku fulani. Rafiki wa kwanza…","config":"sw","split":"test","body":"{\"question\":\"Jerome alikuwa na marafiki 4 waliokuja kumtembelea siku fulani. Rafiki wa kwanza alibonyeza kengele ya mlango mara 20 kabla ya Jerome kufungua, rafiki wa pili alibonyeza kengele ya mlango mara 1/4 zaidi ya rafiki wa kwanza wa Jerome. Rafiki wa tatualibonyeza kengele hiyo mara 10 zaidi ya rafiki wa nne. Iwapo rafiki wa nne alibonyeza kengele ya mlango mara 60, kengele hiyo ya mlango ililia mara ngapi?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}