{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"82cd30bd-4e63-5731-8f92-254f2a2d06f0","task_key":"default--validation--17993","task_revision_id":"1","upstream_id":"17993","short_description":"HellaSwag validation 17993","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to clean your eyebrows [title] Apply your regular face wash to your brows. [step] It's easy to clean your eyebrows with your regular facial cleanser while you're washing your face. Any facial cleanser that is gentle enough for your skin should be fine on your eyebrows.\",\"endings\":\"[\\\"Use gentle touching to help clean those eyebrows. [substeps] The same rule applies if you're concerned about calluses: limit use of your regular facial cleanser while you're trying to clean your eyebrows.\\\", 'Here are some tips : [substeps] Soak your brow milk in warm water. Place your fingertips in the milk and gently massage the milk.', \\\"Wet your eyebrows and apply a small amount of face wash to your brows. [substeps] You can also wash your eyebrows by themselves if you'd prefer.\\\", '[substeps] Because eyebrow powder is such a sensitive pad, you need to make sure you use something noncomedogenic and not irritating to your skin, such as sugar or other aromatic oils. Any product that is non-comedogenic will work fine on eyebrows.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}