{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f3735510-dc4b-5090-ae79-f4636e8874ea","task_key":"all--test--f3735510-dc4b-5090-ae79-f4636e8874ea","task_revision_id":"1","upstream_id":"","short_description":"When a qualitative research is done, the theory is developed from the data, not…","config":"all","split":"test","body":"{\"choices\":\"['Case studies are used for attitude measurement, preferences, & satisfaction', 'Case studies are based on the assumption that the case can be generalized', 'Case studies are most useful as pilot study to identify variables that can be studies in other ways', 'Case studies are the a detailed examination of a single case']\",\"question\":\"When a qualitative research is done, the theory is developed from the data, not before and helps refine hypotheses. From your knowledge about this type of research, which one out of the following statements about CASE STUDIES can not be correct?\",\"subject\":\"professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}