{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a175275c-f4d2-5d78-8022-035b5444b99e","task_key":"all--test--a175275c-f4d2-5d78-8022-035b5444b99e","task_revision_id":"1","upstream_id":"","short_description":"The purpose of evaluating the attractiveness of the differing market segments…","config":"all","split":"test","body":"{\"choices\":\"['Identify the specific members of each segment to be able to contact each of them directly.', 'Determine the level of resources that must be committed to each segment.', 'Evaluate the market potential within each segment.', \\\"Design marketing strategy and tactics to reinforce the firm's image.\\\"]\",\"question\":\" The purpose of evaluating the attractiveness of the differing market segments identified in the second stage of the market segmentation process is to:\",\"subject\":\"marketing\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}