{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a9bf40dd-6d75-5318-a982-8e861a0c9a46","task_key":"es--test--a9bf40dd-6d75-5318-a982-8e861a0c9a46","task_revision_id":"1","upstream_id":"","short_description":"Marcel y Beatrice están haciendo una competencia para ver quién puede comer la…","config":"es","split":"test","body":"{\"question\":\"Marcel y Beatrice están haciendo una competencia para ver quién puede comer la mayor cantidad de rollitos de fruta, por lo que desenrollan todos los que pueden encontrar. Lamentablemente, alguno comete un error y Beatrice estaba a dos rollitos de ancho y 24 rollitos de largo, mientras que Marcell estaba a 3 rollitos de ancho y 14 rollitos de ancho. Si ambos comieron su cantidad completa, ¿cuántos comieron en promedio?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}