{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"26e25e0d-01af-5ee0-8840-781f329443ed","task_key":"all--test--26e25e0d-01af-5ee0-8840-781f329443ed","task_revision_id":"1","upstream_id":"","short_description":"In a clinical trial, 30 sickle cell anemia patients are randomly assigned to two…","config":"all","split":"test","body":"{\"choices\":\"['a completely randomized design, with the currently marketed medicine and the experimental medicine as two treatments', 'a matched-pairs design, with the currently marketed medicine and the experimental medicine forming a pair', 'a randomized block design, with the currently marketed medicine and the experimental medicine as two blocks', 'a randomized block design, with the currently marketed medicine and the experimental medicine as two treatments']\",\"question\":\"In a clinical trial, 30 sickle cell anemia patients are randomly assigned to two groups. One group receives the currently marketed medicine, and the other group receives an experimental medicine. Each week, patients report to the clinic where blood tests are conducted. The lab technician is unaware of the kind of medicine the patient is taking. This design can be described as\",\"subject\":\"high_school_statistics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}