{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ba60de13-ad40-54d8-9919-740d398db32a","task_key":"zh--test--ba60de13-ad40-54d8-9919-740d398db32a","task_revision_id":"1","upstream_id":"","short_description":"比利正在将土豆削皮和切块，准备为他的大型家庭团聚烧烤会制作土豆沙拉。这是一场盛大的活动，所以他得完成 60 颗土豆。土豆都差不多大小，将每颗土豆削皮和切块所用的…","config":"zh","split":"test","body":"{\"question\":\"比利正在将土豆削皮和切块，准备为他的大型家庭团聚烧烤会制作土豆沙拉。这是一场盛大的活动，所以他得完成 60 颗土豆。土豆都差不多大小，将每颗土豆削皮和切块所用的时间差不多相同。比利将一颗土豆削皮需要大约一分半钟，但将一颗土豆切块只需大约 5 秒钟。比利准备好这些土豆需要多长时间？\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}