{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0c369dff-7c0b-5383-9734-ea8b73addf86","task_key":"es--test--0c369dff-7c0b-5383-9734-ea8b73addf86","task_revision_id":"1","upstream_id":"","short_description":"Cuando Freda prepara salsa con tomates enlatados, estos pierden la mitad de su…","config":"es","split":"test","body":"{\"question\":\"Cuando Freda prepara salsa con tomates enlatados, estos pierden la mitad de su volumen. Cada lata de tomates de 16 onzas que usa tiene tres tomates. En la última tanda de salsa de tomate, Freda preparó 32 onzas de salsa. ¿Cuántos tomates usó Freda?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}