{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ad179d4d-582d-5de2-8699-8cb5082bff56","task_key":"sw--test--ad179d4d-582d-5de2-8699-8cb5082bff56","task_revision_id":"1","upstream_id":"","short_description":"Ted the T-Rex alikuwa anapanga kupeleka kachumbari ya viazi kwenye mandari ya…","config":"sw","split":"test","body":"{\"question\":\"Ted the T-Rex alikuwa anapanga kupeleka kachumbari ya viazi kwenye mandari ya dinosaria. Anajua kuwa dinosaria mkubwa atakula lb 10 za kachumbari ya viazi, na mtoto atakula nusu ya kiwango ambacho mkubwa atakula. Iwapo kutakuwa na wakubwa 20 na watoto 5 katika mandari hiyo, Ted anahitaji kuleta pauni ngapi za kachumbari ya viazi kwenye mandari ikiwa anatarajia kulisha kila dinosaria?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}