{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9af35821-5f6a-504b-a9ad-3484fd5cbedc","task_key":"de--test--9af35821-5f6a-504b-a9ad-3484fd5cbedc","task_revision_id":"1","upstream_id":"","short_description":"Elaine hatte anfänglich 20 Pokemonkarten. Nach einem Monat hatte sie das…","config":"de","split":"test","body":"{\"question\":\"Elaine hatte anfänglich 20 Pokemonkarten. Nach einem Monat hatte sie das Dreifache dieser Zahl gesammelt. Im zweiten Monat sammelte sie 20 Karten weniger, als sie im ersten Monat gesammelt hatte. Im dritten Monat sammelte sie das Doppelte der Anzahl Pokemonkarten, die sie im ersten und zweiten Monat zusammen gesammelt hatte. Wie viele Pokemonkarten hat sie jetzt insgesamt?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}