{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"70f6f6a0-d014-5b9e-8cd3-880824317ac6","task_key":"sw--test--70f6f6a0-d014-5b9e-8cd3-880824317ac6","task_revision_id":"1","upstream_id":"","short_description":"Candice aliweka karatasi 80 zenye vibandiko kwenye pochi lake kabla ya kuondoka…","config":"sw","split":"test","body":"{\"question\":\"Candice aliweka karatasi 80 zenye vibandiko kwenye pochi lake kabla ya kuondoka kwenda kazini katika duka lake la kahawa. Akiwa njiani, alisimama katika duka na kununua kifurushi cha karatasi zenye Kibandiko; Akiwa kazini, aliweka katarasi moja yenye kibandiko kwenye vikombe 220 tofauti vya kahawa. Iwapo alikuwa amesalia na karatasi 23 zenye vibandiko kwa jumla, karatasi ngapi zenye vibandiko zilikuwa katika kifurushi alichonunua?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}