{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"98021515-00dd-5cf5-addc-717b8e587b68","task_key":"sw--test--98021515-00dd-5cf5-addc-717b8e587b68","task_revision_id":"1","upstream_id":"","short_description":"Kwa ajili ya siku yake ya kuzaliwa ya 30, Elvira alichagua kompyuta mpya iliyo…","config":"sw","split":"test","body":"{\"question\":\"Kwa ajili ya siku yake ya kuzaliwa ya 30, Elvira alichagua kompyuta mpya iliyo na vifaa zaidi kama zawadi. Ana bajeti ya yuro 1500 aliyochangiwa na familia yake nzima na anadhani kuwa ataweza kubakisha pesa kiasi ya kununua nguo. Anaenda kwenye duka la kompyuta na kuchagua mashine inayogharimu yuro 1090 iliyo na skrini, kibodi na kipanya. Pia anachukua kitambazi kwa yuro 157, kichapishaji cha santuri kwa yuro 74 na kichapishaji kwa yuro 102. Atakuwa amesalia na pesa ngapi za kununua nguo yake?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}