{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"624460e7-5b73-5fbe-9817-c816d6156b95","task_key":"sw--test--624460e7-5b73-5fbe-9817-c816d6156b95","task_revision_id":"1","upstream_id":"","short_description":"Sophia anafikiria kwenda safari kwa kutumia gari lake, na angependa kujua umbali…","config":"sw","split":"test","body":"{\"question\":\"Sophia anafikiria kwenda safari kwa kutumia gari lake, na angependa kujua umbali ambao anaweza kwenda kwa tangi moja ya mafuta ya gari. Amesafiri maili 100 tangu mara ya mwisho alipojaza tangi yake, na alihitaji kuongeza galoni 4 za mafuta ya gari ili kujaza tangi yake tena. Kitabu cha mwongozo cha gari lake kinasema kuwa tangi yake inabeba galoni 12 za mafuta ya gari. Sophia anaweza kuendesha maili ngapi kwa kutumia tangi moja ya mafuta ya gari?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}