{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"603c0216-7d0a-5a4d-8469-855233a957e0","task_key":"sw--test--603c0216-7d0a-5a4d-8469-855233a957e0","task_revision_id":"1","upstream_id":"","short_description":"Chakula ambacho Carl anapenda zaidi ni jibini. Alikula sandwichi kila siku wiki…","config":"sw","split":"test","body":"{\"question\":\"Chakula ambacho Carl anapenda zaidi ni jibini. Alikula sandwichi kila siku wiki hii wakati wa chakula cha mchana na kutumia slaisi 2 za jibini kwenye kila sandwichi. Alikula jibini na omleti za mayai wakati wa staftahi siku 3 katika wiki hiyo na omleti moja ilikuwa na slaisi moja zaidi ya jibini kuliko katika sandwichi yake. Aliandaa mlo mkubwa wa makaroni na jibini wa kumtoshea chajio kadhaa kwa wiki hiyo na akatumia slaisi 8 za jibini kwenye mlo huo. Alitumia slaisi ngapi za jibini kwa jumla?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}