{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e43aeed1-068e-5998-8fde-0be18178947d","task_key":"default--validation--27210","task_revision_id":"1","upstream_id":"27210","short_description":"HellaSwag validation 27210","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to prepare oily skin for makeup [title] Wash your face with a gentle cleanser. [step] They key to getting a healthy glow with makeup is making sure the palette-your face--underneath is clean. Use a gentle, ph-balanced cleanser to clear any dirt or excess oil off of your skin.\",\"endings\":\"['[substeps] If you have oily skin, use a facial cleanser instead of a pore-cleansing product. Because pore-cleansing products can dry out your skin, avoid that part of your face.', \\\"[substeps] You may want to consider using a gel cleanser, which is often gentle and doesn't have excess oils that could exacerbate your oily skin. Avoid using products that are heavy in chemicals, which may irritate your skin and increase oil production.\\\", 'Never use a cleanser with salicylic acid, but you should also avoid regular facial cleansers that will leave your skin looking oily. [substeps] Look for products that are 100% organic; these will not only prevent you from picking at dirt, but also have antimicrobial properties.', 'Put some jojoba oil into a large bowl, and fill it with warm water and a little apple cider vinegar. Use your fingertips to gently pat away any excess sugar.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}