{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c9945c08-0cda-53a9-bc84-8517f946eb83","task_key":"all--test--c9945c08-0cda-53a9-bc84-8517f946eb83","task_revision_id":"1","upstream_id":"","short_description":"To be effective, the process of market segmentation must meet which of the…","config":"all","split":"test","body":"{\"choices\":\"['The firm must avoid focusing on non-variables such as profitability and volume.', 'The market segment must have measurable purchasing power and size.', 'The company must expand beyond its marketing capabilities to capture growing markets.', \\\"The market segment must reflect the population's changing attitudes and lifestyles.\\\"]\",\"question\":\"To be effective, the process of market segmentation must meet which of the following basic requirements?\",\"subject\":\"marketing\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}