{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ab75ae5f-1160-5646-996b-2e621a3d04a2","task_key":"default--validation--32579","task_revision_id":"1","upstream_id":"32579","short_description":"HellaSwag validation 32579","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to apply powder blush [title] Use powder blush if you have oily skin. [step] Forms of blush made out of liquid and cream do not hold up well on oily skin. Powder blush, on the other hand, deals with natural oil extremely well, lasting far longer without the need for constant reapplication.\",\"endings\":\"['It allows access to more pigments, or even gives you a little boost in saturation. Type of blush works for both oily and dry skin, but figure out what type of blush works best for you.', \\\"[title] Pick a blush shade that matches your skin tone. [step] If you're going for a natural look, you'll want to pick a blush color that complements your skin tone.\\\", 'For this reason, powders are best for any skin type. [substeps] For oily skin, avoid powder blush, since it likely contains less oil than you want to achieve.', 'If you are putting powder blush on your face, apply a clear base blush (a solid shade) at least four shades lighter than your skin. Dip your finger into the liquid or cream blush and begin dabbing the powder into your face.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}