{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8b4ca875-f528-53f1-8d60-6576ec6005f5","task_key":"sw--test--8b4ca875-f528-53f1-8d60-6576ec6005f5","task_revision_id":"1","upstream_id":"","short_description":"Billy anamenya na kukata viazi akiwa anajiandaa kutengeneza saladi ya viazi kwa…","config":"sw","split":"test","body":"{\"question\":\"Billy anamenya na kukata viazi akiwa anajiandaa kutengeneza saladi ya viazi kwa ajili ya nyama choma ya mkutano wa familia yake kubwa. Ni tukio kubwa, hivyo ana viazi 60 vya kushughulikia. Viazi vina ukubwa ambao takriban unatoshana, hivyo inachukua karibu muda swa kumenya na kukata kila kimoja. Inamchukua Billy dakika moja na nusu kumenya viazi, lakini sekunde 5 pekee kukikata. Itamchukua Billy muda gani kukamilisha kuandaa viazi hivyo?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}