{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f846d66e-2d9a-5678-b958-50679963b4f7","task_key":"default--validation--11067","task_revision_id":"1","upstream_id":"11067","short_description":"HellaSwag validation 11067","config":"default","split":"validation","body":"{\"activity_label\":\"Work World\",\"ctx\":\"[header] How to prevent medication errors in nursing [title] Utilize at least 2 identifiers that are specific to the patient before administering medication. [step] For example, along with the patient's name, ask for his date of birth to make sure the prescription matches the patient. [substeps] Have a system to identify those patients who have similar names.\",\"endings\":\"['For example, \\\" mary messenger, \\\" \\\" molly anderson, \\\" and \\\" leyr mickitude. \\\" [title] Ask for important medical information like birthdates or age.', 'This way, when an employee finishes a productive job, the patient\\\\'s name is less likely to be called out in his place. Physicians should provide a \\\" tag \\\" database to provide a telltale presence when an individual receives medication.', 'Ask if the patient has had medicines prescribed in the past with similar names. This will help you to quickly identify people who have different names.', \\\"It can be as simple as a special sticker or marker on the patient's chart. In these instances, another identifier may be needed to avoid medication errors.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}