{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmmu-pro","formal_name":"MMMU-Pro","introduction":"MMMU-Pro evaluates multimodal understanding across academic disciplines using images and text. The official card lists 1,730 questions per setting, separating four-option and ten-option standard settings from the vision setting.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://mmmu-benchmark.github.io/","indexing_mode":"noindex","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[]}},"task_id":"b2666cc4-6423-5c85-a5ab-3354ea543d49","task_key":"standard~20~2810~20options~29--test--validation~5fSociology~5f29","task_revision_id":"3","upstream_id":"validation_Sociology_29","short_description":"Which statement represents stratification from the perspective of <image 1>?","config":"standard (10 options)","split":"test","body":"{\"img_type\":\"['Diagrams']\",\"options\":\"['Teachers continue to struggle to keep benefits such as good retirement plans.', 'Wealthy individuals often have better access to educational opportunities.', 'An office worker might feel out of place in a blue-collar pub.', 'Doctors earn more money because their job is more highly valued.', 'Men often earn more than women, even working the same job.', 'Fast food employees are not respected as much as gourmet chefs.', 'Lawyers typically choose to live in upscale neighborhoods.', \\\"Factory workers often don't have access to the same healthcare benefits as corporate executives.\\\", 'After work, Pat, a janitor, feels more comfortable eating in a truck stop than a French restaurant.', 'Professional athletes often earn more than teachers and nurses.']\",\"question\":\"Which statement represents stratification from the perspective of <image 1>?\",\"subject\":\"Sociology\"}","display_format":"text","language":"","answer_status":"published","assets":[{"kind":"file","reference_id":"task:b2666cc4-6423-5c85-a5ab-3354ea543d49:3:image_1.png","filename":"image_1.png","media_type":"image/png","alt":""}],"source_url":"https://mmmu-benchmark.github.io/","history":"initial import","indexing_mode":"noindex","subproblems":[],"grids":[]}