{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmmu-pro","formal_name":"MMMU-Pro","introduction":"多様な学問分野の画像とテキストを組み合わせ、マルチモーダル理解を評価するベンチマークです。公式データカードでは各設定に1,730問があり、4択・10択の標準設定と画像のみの設定を区別します。\n\nMMMU-Pro evaluates multimodal understanding across academic disciplines using images and text. The official card lists 1,730 questions per setting, separating four-option and ten-option standard settings from the vision setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://mmmu-benchmark.github.io/","indexing_mode":"noindex"},"task_id":"2084dd9e-27ad-521d-9ca0-cf8aff20c9d9","task_key":"standard~20~2810~20options~29--test--test~5fMath~5f170","task_revision_id":"1","upstream_id":"test_Math_170","short_description":"A study was set up to look at counts of CD4+ T helper cells in a group of 17…","config":"standard (10 options)","split":"test","body":"{\"img_type\":\"['Tables']\",\"options\":\"['Z-test', 'One sample t-test', 'Chi-square test', 'None of the t-tests would be suitable', 'Dependent samples t-test', 'Analysis of Variance (ANOVA) test', 'Paired samples t-test', 'Independent samples t-test', 'Multiple samples t-test', 'Two sample t-test']\",\"question\":\"A study was set up to look at counts of CD4+ T helper cells in a group of 17 healthy volunteers and a separate group of 7 immunocompromised patients. <image 1> is a snapshot of the data. A histogram of these CD4+ cell counts has shown that the distribution is negatively skewed. If we wanted to test for differences between the average values in Healthy volunteers compared to immunocompromised patients which type of t-test should be used?\",\"subject\":\"Math\"}","display_format":"text","language":"","answer_status":"published","assets":[{"kind":"file","reference_id":"task:2084dd9e-27ad-521d-9ca0-cf8aff20c9d9:1:image_1.png","filename":"image_1.png","media_type":"image/png","alt":""}],"source_url":"https://mmmu-benchmark.github.io/","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}