{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ea58da60-908d-54aa-9452-ec9b7c637669","task_key":"sw--test--ea58da60-908d-54aa-9452-ec9b7c637669","task_revision_id":"1","upstream_id":"","short_description":"Julia alikuwa anaandaa sherehe ya chakula cha jioni katika nyumba yake, ambapo…","config":"sw","split":"test","body":"{\"question\":\"Julia alikuwa anaandaa sherehe ya chakula cha jioni katika nyumba yake, ambapo alikuwa amelenga kupakulia watu mchuzi. Aligundua kuwa vijiko vyake vya plastiki vilikuwa vimeisha, hivyo alinunua kifurushi cha vijiko vipya. Baadaye, mume wake pia alinunua kifurushi cha vijiko 5 vipya na akapatia Julia. Wakati Julia alikuwa anaandaa mchuzi, alitumia vijiko vitatu kati ya vijiko vyote kuonja mchuzi wake. Baadaye, alipoenda kuandaa meza, alikuwa na jumla ya vijiko 12. Vijiko vingapi vilikuwa katika kifurushi ambacho Julia alinunua?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}