{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ee998678-5ce2-563a-8210-d5026c13373b","task_key":"zh--test--ee998678-5ce2-563a-8210-d5026c13373b","task_revision_id":"1","upstream_id":"","short_description":"约翰以每小时 60 英里的速度开了 3 小时，然后掉头，因为他意识到自己把非常重要的东西忘在家里了。他尽量在 4 小时后赶到家，但前 2 个小时都消耗在堵塞的交…","config":"zh","split":"test","body":"{\"question\":\"约翰以每小时 60 英里的速度开了 3 小时，然后掉头，因为他意识到自己把非常重要的东西忘在家里了。他尽量在 4 小时后赶到家，但前 2 个小时都消耗在堵塞的交通中了。在接下来的半个小时，他以每小时 30 英里的速度驾驶，然后在 4 小时剩下的时间里，才能以每小时 80 英里的速度行驶。4 个小时结束后，他距离家还有多远？\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}