{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3ea13af6-3e92-5fd8-937f-82eb039595c8","task_key":"fr--test--3ea13af6-3e92-5fd8-937f-82eb039595c8","task_revision_id":"1","upstream_id":"","short_description":"Charlie veut vendre des bougies en cire d'abeille. Chaque livre de cire…","config":"fr","split":"test","body":"{\"question\":\"Charlie veut vendre des bougies en cire d'abeille. Chaque livre de cire d'abeille lui permet de produire 10 bougies effilées. Une livre de cire d'abeille et de mèches est livrée au prix de 10,00 $. S'il produit et vend 20 bougies, quel est son bénéfice net, sachant que chaque bougie est vendu à 2,00 $ ?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}