{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bc80a1ae-6926-5f34-9f96-0a720ecdc523","task_key":"sw--test--bc80a1ae-6926-5f34-9f96-0a720ecdc523","task_revision_id":"1","upstream_id":"","short_description":"Bibiye Jones alioka keki 5 za tufaha kwa ajili ya chamcha ya afisa wa kuzima…","config":"sw","split":"test","body":"{\"question\":\"Bibiye Jones alioka keki 5 za tufaha kwa ajili ya chamcha ya afisa wa kuzima moto. Alikata kila keki kwa vipande 8 na kupanga keki tano kwenye meza ya chakula cha kujipakulia ili wageni waweze kujipakulia. Mwishoni mwa jioni, baada ya wageni kuchukua na kula vipande vyao vya keki, kulikuwa na vipande 14 vya keki ambavyo vilikuwa vimesalia. Wageni walikula vipande vingapi?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}