{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"abec02b6-86e1-5627-9c38-4e56558c4c3a","task_key":"all--test--abec02b6-86e1-5627-9c38-4e56558c4c3a","task_revision_id":"1","upstream_id":"","short_description":"Professor Ek is interested in studying online bullying behaviors of middle…","config":"all","split":"test","body":"{\"choices\":\"['Experiment-the most convenient and ethical way to study online bullying is to randomly assign half of the participants to a group who experiences the independent variable (online bullying).', 'Correlation-it would be unethical to purposefully expose middle school students to bullying behaviors, so Professor Ek should examine variables that correlate with existing instances of online bullying.', 'Naturalistic observation-observing instances of online bullying by monitoring middle school students\\\\' social networking behavior would provide the most accurate data and not raise important privacy concerns, because social networks are considered \\\"public\\\" space.', 'Survey-self-reports about online bullying behaviors and responses to these behaviors would likely provide the most accurate descriptions of bullying and its impact.']\",\"question\":\"Professor Ek is interested in studying online bullying behaviors of middle school students. Which of the following research method choices (and the rationale for the choice) is the most appropriate?\",\"subject\":\"high_school_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}