{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6e943926-7950-5cd9-84ab-ed7e7da4b6b3","task_key":"sw--test--6e943926-7950-5cd9-84ab-ed7e7da4b6b3","task_revision_id":"1","upstream_id":"","short_description":"Afisa wa forodha katika bandari kuu ya ukaguzi wa SeaSide alihesabu kontena 2 za…","config":"sw","split":"test","body":"{\"question\":\"Afisa wa forodha katika bandari kuu ya ukaguzi wa SeaSide alihesabu kontena 2 za magari yaliyotolewa nje ya nchi, kila kontena ikiwa na magari 5 ndani yake. Siku iliyofuata, kontena zaidi zililetwa, na jumla ya idadi ya magari katika bandari hiyo ilikuwa 30. Piga hesabu ya idadi ya kontena ambazo zilinunuliwa kutoka nje ya nchi siku ya pili, ukichukulia kuwa kontena zote zilikuwa na magari 5.\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}