{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0b465c70-18ca-5ae2-b138-eea6c6f72a50","task_key":"sw--test--0b465c70-18ca-5ae2-b138-eea6c6f72a50","task_revision_id":"1","upstream_id":"","short_description":"Nina lita 10 za kinywaji cha chungwa ambacho theluthi mbili zake ni maji na…","config":"sw","split":"test","body":"{\"question\":\"Nina lita 10 za kinywaji cha chungwa ambacho theluthi mbili zake ni maji na ningependelea kukiongeza kwenye lita 15 za kinyaji cha nanasi ambacho humusi tatu zake ni maji. Lakini ninapokimimina, nimemwaga lita moja ya kinywaji cha chungwa. Kiasi kipi cha maji kipo kwenye lita 24 zinazosalia?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}