{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0cb65c19-6acf-54b1-91dd-93051a93bd01","task_key":"default--validation--23020","task_revision_id":"1","upstream_id":"23020","short_description":"HellaSwag validation 23020","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get rid of dark lips [title] Use make-up to lighten your lips for the night. [step] Whether for a party, costume, or new \\\" look, \\\" you can make-up to brighten your lips without causing long term changes or damage. [substeps] Try out lighter lip sticks colors, like peach or coral.\",\"endings\":\"['Talk to your lip-care professional about what kinds of lipstick work best and what you might like your lips to have before taking a night off. Dark lipstick will dry out your lips and keep them from being used for daytime interactions, including a costume party.', \\\"Use lip gels and clear lip gloss to add moisture, stay in place throughout the night, and reassure your skin that the brightening effect is beginning. You'll also want to consider applying concealer under your lips, where breakage is less, and concealer beneath your eyelids.\\\", 'Other colors color your lips for the night out, rather than just one. No makeup works as well, but a warm lipstick, eyeshadow color or lip glomp might or may lighten your lips for the night out.', 'Use powder or concealer to lighten lips a little bit at a time. [title] Mix and match powder and concealer with your lip gloss to a more specific tint.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}