{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9e3affa1-fd11-5eef-8e02-f268277f3023","task_key":"all--test--9e3affa1-fd11-5eef-8e02-f268277f3023","task_revision_id":"1","upstream_id":"","short_description":"Why should a patient stand or sit as upright as possible when recording a peak…","config":"all","split":"test","body":"{\"choices\":\"['To ensure best lung expansion and accuracy and consistency of readings.', 'This is the most comfortable position to perform any breathing test.', 'The counter on the meter will not move if the patient is lying down.', 'To ensure that their technique can be observed easily.']\",\"question\":\"Why should a patient stand or sit as upright as possible when recording a peak flow rate?\",\"subject\":\"clinical_knowledge\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}