{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c0fe1422-cc02-5597-a44f-f40345757622","task_key":"es--test--c0fe1422-cc02-5597-a44f-f40345757622","task_revision_id":"1","upstream_id":"","short_description":"Mark es revisor de texto. Todas las semanas, revisa la misma cantidad de…","config":"es","split":"test","body":"{\"question\":\"Mark es revisor de texto. Todas las semanas, revisa la misma cantidad de oraciones para dos editoriales distintas, que le pagan una tarifa diferente por oración. La editorial B, le paga a Mark el doble de lo que le paga la editorial A. Mark revisa una cantidad total de 1000 oraciones cada semana, y la editorial A le paga 5 centavos la oración. ¿Cuántos centavos gana Mark en una semana?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}