{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6b186b7d-4231-5684-980d-629f06e8895f","task_key":"fr--test--6b186b7d-4231-5684-980d-629f06e8895f","task_revision_id":"1","upstream_id":"","short_description":"Pendant qu'elle achète des chaussures, Gloria tombe sur une paire de bottines…","config":"fr","split":"test","body":"{\"question\":\"Pendant qu'elle achète des chaussures, Gloria tombe sur une paire de bottines qui rentre dans son budget. Toutefois, elle doit choisir entre les bottines et deux paires de talons hauts qui coûtent à elles deux cinq dollars de moins que les bottines. Si l'une des paires de talons hauts coûte 33 $ et que l'autre coûte deux fois plus, quel est, en dollar, le prix des bottines ?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}