{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3e9c210a-dd5d-57db-85ad-0a74af454e84","task_key":"sw--test--3e9c210a-dd5d-57db-85ad-0a74af454e84","task_revision_id":"1","upstream_id":"","short_description":"Russel anafanya kazi katika duka la wanyama wapenzi na anasambaza mirija…","config":"sw","split":"test","body":"{\"question\":\"Russel anafanya kazi katika duka la wanyama wapenzi na anasambaza mirija miongoni mwa wanyama wagugunaji. Panya wamewekwa katika mabanda 3 katika vikundi vinavyotoshana na kila panya amepewa vipande 6 vya mrija. Kuna mabanda 10 ya buku ambao wamewekwa pekee yao na kila buku anapewa mirija 5. Pia kuna kundi la sungura ambapo vipande 20 vya mrija vimegawanywa miongoni mwa sungura. Hakuna mrija uliotumika kwingine tena katika duka. Iwapo vipanade 160 vya mrija vilikuwa vimesambazwa miongoni mwa wanyama wagugumizi, kuna panya wangapi katika kila banda?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}