{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"82116bf2-9758-59fd-bec5-7dbe4547243d","task_key":"sw--test--82116bf2-9758-59fd-bec5-7dbe4547243d","task_revision_id":"1","upstream_id":"","short_description":"Henry anatengeneza biskuti kwa ajili ya shindano la ndani ya kuoka. Anataka…","config":"sw","split":"test","body":"{\"question\":\"Henry anatengeneza biskuti kwa ajili ya shindano la ndani ya kuoka. Anataka kutengeneza mara mbili zaidi ya alizotengeneza mwaka jana. Akikamilisha kuoka, anagundua kuwa alioka biskuti 15 zaidi ya alivyotarajia. Biskuti 5 zilianguka alipokuwa akiziweka ili zipoe, na sasa ana jumla ya biskuti 110. Henry alioka biskuti ngapi mwaka jana?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}