{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f230d02d-ad33-5fd2-987f-8df89bf5f428","task_key":"default--validation--9596","task_revision_id":"1","upstream_id":"9596","short_description":"HellaSwag validation 9596","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to apply eyeliner that stays all day [title] Remove excess oil. [step] Oily lids are one of the main reasons why eyeliner can smudge. Before you apply your eyeliner, make sure your lids are not oily.\",\"endings\":\"[\\\"Strive to remove all oily oil that clings to your eyelids. [substeps] Though it's possible to apply makeup without a lid, eyeliner tends to creep into pores and make them look worse.\\\", 'Take an oil-free makeup remover, apply several drops to a cotton ball, and pat the cotton ball on your eyelid. This should remove the excess oil from your lids.', 'The oil you use can be any color imaginable, but it can be a good idea to let your lids air dry so they avoid shining and other issues. [substeps] This does not necessarily mean wipe a little oil on the edges of your lids.', 'If they are, apply a short coverage highlight product across your lids to soften any split ends. You can use plastic makeup containers with lids to quickly rid your lids of excess oil.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}