{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"580f2d7d-f48b-51f1-8b7c-c7b8e0ce99d1","task_key":"es--test--580f2d7d-f48b-51f1-8b7c-c7b8e0ce99d1","task_revision_id":"1","upstream_id":"","short_description":"Mientras está en la tienda \"Todo por un dólar\", Sloane cuenta 100 clientes que…","config":"es","split":"test","body":"{\"question\":\"Mientras está en la tienda \\\"Todo por un dólar\\\", Sloane cuenta 100 clientes que ingresan en la tienda. Al día siguiente, cuenta 50 clientes más que el primer día. Si la cantidad total de clientes al cabo del tercer día fue 500, ¿cuántos clientes contó el tercer día?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}