{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1ebab6ac-dd90-5482-ac2e-a5f556baa313","task_key":"sw--test--1ebab6ac-dd90-5482-ac2e-a5f556baa313","task_revision_id":"1","upstream_id":"","short_description":"Cecilia amenunua mtoto mdogo wa umbwa. Kulingana na daktari wake wa wanyama,…","config":"sw","split":"test","body":"{\"question\":\"Cecilia amenunua mtoto mdogo wa umbwa. Kulingana na daktari wake wa wanyama, anahitaji kumlisha mtoto huyo wa mbwa kikombe 1 cha chakula cha mbwa kila siku kwa siku 180 za kwanza. Kisha anahitaji kumlisha mtoto huyo wa mbwa vikombe 2 vya chakula cha mbwa kila siku kwa maisha yake yote. Iwapo mfuko moja wa chakula cha mbwa una vikombe 110, Cecilia atatumia mifuko mingapi ya chakula cha mbwa kwa mwaka wa kwanza?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}