{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6f0f373a-ecda-5962-b15b-0656c42d8ca4","task_key":"default--validation--22433","task_revision_id":"1","upstream_id":"22433","short_description":"HellaSwag validation 22433","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to make cuts heal faster [title] Wash your hands. [step] Before caring for your wound, you'll need to make sure your hands are clean so you don't transfer bacteria into the cut. Make sure you go through the correct process of washing your hands to ensure they are as clean as possible.\",\"endings\":\"[\\\"[substeps] Use warm or not-too-hot water and mild soap to wash your hands so you don't worsen the cut. Lather your hands under warm or not-too-hot water and scrub your hands for five to 10 seconds.\\\", '[substeps] Make sure you clean the skin around any cuts or bruised areas. Put on a pair of clean medical gloves to protect your hands.', 'Rinse your hands gently under running water to get rid of all of the particles and dirt. [substeps] Good washing practices include: washing your hands before and after touching a wound, or after vigorous activities such as cleaning the wound with soapy water.', '[substeps] Wet your hands with clean, running water. Apply soap and lather your hands by rubbing them together.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}