{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f987b66e-13b0-56a7-aa59-46f6b920e244","task_key":"default--validation--18963","task_revision_id":"1","upstream_id":"18963","short_description":"HellaSwag validation 18963","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to do dot eyeliner [title] Use a waterproof black or brown eyeliner. [step] The most basic, and also most natural looking, dot eyeliner look is created with either brown or black eyeliner. Black is generally preferred if you want to create a doll-like appearance, which is often the aim of this trend.\",\"endings\":\"[\\\"However, it's important to mix the two styles to get a balanced effect. Black eyeliner tends to look best on dolls anyway, as it isn't as coarse as it would be with other types of eyeliner.\\\", 'To make sure your look stays put, use a waterproof eyeliner. [substeps] Start with brown eyeliner if black feels too dramatic for you.', '[title] To create a \\\" dog face \\\" look, use a black or brown eyeliner. [step] Place the eyeliner in the very center of the eye, just beneath your lash line.', \\\"[substeps] The eyeliner should be only visible when you're not using it on most of the time, unless you're wearing colored pencil. You can always use black eyeliner, but if you only do it occasionally, dark brown eyeliner will work just as well.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}