{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mgsm","formal_name":"MGSM","introduction":"MGSM is a human translation of 250 GSM8K problems into eleven languages, measuring whether reasoning survives the change of language. The gap against English is the multilingual signal.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/google-research/url-nlp","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8ba8b469-d071-5593-bda1-99bf3868d5f3","task_key":"de--test--8ba8b469-d071-5593-bda1-99bf3868d5f3","task_revision_id":"1","upstream_id":"","short_description":"Gene näht eine Decke aus alten Erinnerungs-T-Shirts. Er hat ein T-Shirt aus…","config":"de","split":"test","body":"{\"question\":\"Gene näht eine Decke aus alten Erinnerungs-T-Shirts. Er hat ein T-Shirt aus jedem Urlaub, in dem er war. Jedes Shirt bildet einen eigenen Deckenabschnitt. Jede Reihe ist aus Abschnitten eines anderen Ferienjahrs gefertigt. Er macht viermal im Jahr Urlaub und verreist, seit er 23 Jahre alt ist. Jetzt ist er 34 Jahre alt. Wie viele Deckenabschnitte hat er insgesamt?\"}","display_format":"math","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/google-research/url-nlp","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}