{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"89e0ec5c-cd67-5e23-a99a-91d9e1e4b655","task_key":"default--validation--31323--variant-ca7637ff4f1d","task_revision_id":"1","upstream_id":"31323--variant-ca7637ff4f1d","short_description":"HellaSwag validation 31323","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to prepare your skin for waxing [title] Let your hair grow. [step] Don't book a waxing appointment until you haven't waxed for least one to two weeks. Ideally, you should have 1/4 inch (. 635 cm) of hair in the area you want to wax.\",\"endings\":\"['Additionally, waxing will help repair damaged skin and nourish the skin. Let a few days or no more than a couple weeks pass between waxing times to allow for new growth.', \\\"Don't wait until your hair has grown beyond this length unless you absolutely have to. Shedding your hairs to cut them will prolong your wait time.\\\", \\\"If it's not a waxing appointment, follow the instructions provided in the waxing kit for best results. [title] Apply a 30% moisturizing oil.\\\", \\\"Waxing will be more painless and effective if you wait long enough to wax. [substeps] The exception to this is fine hair, like women's facial hair.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}