{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"27138ed6-043d-5211-b8cf-101f90ed05be","task_key":"sw--test--27138ed6-043d-5211-b8cf-101f90ed05be","task_revision_id":"1","upstream_id":"","short_description":"Timu mbili za mbio za uwanjani zinashindana na kila moja katika mbio za…","config":"sw","split":"test","body":"{\"question\":\"Timu mbili za mbio za uwanjani zinashindana na kila moja katika mbio za kupokezana kijiti za 4 kwa mita 400; mbio ambapo kila timu inayoshindana ina wanachama wanne ambao kila mmoja anakimbia mita 400, au kuzunguka mara moja, kwenye uwanja kamili. Mojawapo kati ya timu hizo mbili ina wakimbiaji wazuri na kila mmoja wao atakimbia mkondo wao wa mita 400 kwa sekunde 55. Timu hiyo nyingine haina wakimbiaji wazuri vile; mkimbiaji wao wa kwanza atakimbia mkondo wao wa mita 400 kwa sekunde 60 kisha kila mkimbiaji anayefuata atakuwa na kasi ya sekunde 3 zaidi ya aliyemtangulia. Kwa kutumia maelezo haya, timu iliyo na mbio ya haraka zaidi itashinda kwa sekunde ngapi?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}