{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f0238314-ab1f-58c8-8c11-d6a089e5efc7","task_key":"sw--test--f0238314-ab1f-58c8-8c11-d6a089e5efc7","task_revision_id":"1","upstream_id":"","short_description":"Dave alinunua kifurushi kikubwa cha chipsi na akala kumi na nne kabla ya shakwe…","config":"sw","split":"test","body":"{\"question\":\"Dave alinunua kifurushi kikubwa cha chipsi na akala kumi na nne kabla ya shakwe aliye na njaa kuiba kifurushi hicho kutoka kwa mkono wake. Shakwe huyo alipotua, aligooka nusu ya chipsi ambazo Dave alikuwa amekula. Kisha njiwa watatu wakamfurusha kutoka kwa chakula hicho, na kila njiwa akala chipsi tatu. Baadaye, rakuni aliiba theluthi mbili ya chipsi zilizosalia. Siafu wakabeba chipsi ya mwisho, na kuacha tano nyuma. Kulikuwa na chipsi ngapi katika kifurushi hicho wakati Dave alikinunua?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}