{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"46d60ddc-2756-5710-bc18-5e55859e6ea9","task_key":"sw--test--46d60ddc-2756-5710-bc18-5e55859e6ea9","task_revision_id":"1","upstream_id":"","short_description":"Kila siku, Wendi hulisha kila mmoja kati ya kuku wake vikombe vitatu vya chakula…","config":"sw","split":"test","body":"{\"question\":\"Kila siku, Wendi hulisha kila mmoja kati ya kuku wake vikombe vitatu vya chakula mseto cha kuku, kilicho na mbegu, wadudu na mboga ili kusaidia kudumisha afya yao nzuri. Yeye hupatia kuku hao chakula chao katika milo mitatu tofauti. Asubuhi, huwapa kuku wake vikombe 15 vya chakula. Mchana, huwapa kuku wake vikombe vingine 25 vya chakula. Anahitaji kuwapa kuku wake vikombe vingapi vya chakula katika mlo wa mwisho wa siku iwapo idadi ya kuku wa Wendi ni kuku 20?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}