{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"edfaa482-9a8a-5df7-8556-9bf9e92c4364","task_key":"zh--test--edfaa482-9a8a-5df7-8556-9bf9e92c4364","task_revision_id":"1","upstream_id":"","short_description":"马克昨天参加了一场由 75 道题构成的测验。他以每小时完成 5 道题的速度完成了这场测验。今天，他以同样的速度参加了另一场 100 道题的测验。如果马克有 8 …","config":"zh","split":"test","body":"{\"question\":\"马克昨天参加了一场由 75 道题构成的测验。他以每小时完成 5 道题的速度完成了这场测验。今天，他以同样的速度参加了另一场 100 道题的测验。如果马克有 8 小时的时间完成第一场测验，并且有 6 小时的时间完成第二场测验，则他有多少道题没有作答？\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}