{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"672f97b8-a25f-56bf-af7f-a5e1a8438061","task_key":"all--test--672f97b8-a25f-56bf-af7f-a5e1a8438061","task_revision_id":"1","upstream_id":"","short_description":"When it comes to Controlling for Threats to Internal Validity, there is a…","config":"all","split":"test","body":"{\"choices\":\"['assignment is how you choose people for the study', 'selection is what group they go in', 'selection is how you choose people for the study and assignment is what group they go in', 'selection- adds additional experimental groups, while assignment identifying subjects who are similar on the EV and dividing between groups']\",\"question\":\"When it comes to Controlling for Threats to Internal Validity, there is a certain difference between RANDOM ASSIGNMENT AND RANDOM SELECTION. From your knowledge about this topic, in what does it consist?\",\"subject\":\"professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}