{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"95df3c19-2127-5742-bc2b-958a90de05cf","task_key":"es--test--95df3c19-2127-5742-bc2b-958a90de05cf","task_revision_id":"1","upstream_id":"","short_description":"El gran dragón, Perg, se sentó en lo alto del monte Farbo, escupiendo fuego a…","config":"es","split":"test","body":"{\"question\":\"El gran dragón, Perg, se sentó en lo alto del monte Farbo, escupiendo fuego a todo lo que se encontraba a una distancia de 1000 pies. Polly podía lanzar la jabalina de oro, la única arma conocida que podía matar al dragón, a una distancia de 400 pies, bien al alcance de las llamas del dragón. Pero cuando Polly tenía la piedra preciosa de zafiro, podía lanzar la jabalina tres veces más lejos que cuando no la tenía. ¿A qué distancia fuera del alcance de las llamas del dragón podría pararse Polly para poder golpear al dragón con la jabalina de oro teniendo la piedra preciosa?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}