{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"063df19b-9039-5267-be69-00937604e6c8","task_key":"default--validation--3212","task_revision_id":"1","upstream_id":"3212","short_description":"HellaSwag validation 3212","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to scrunch hair without gel & mousse [title] Start with slightly damp hair. [step] This works best if you have no products in your hair. The hair should have been washed today or yesterday.\",\"endings\":\"['[substeps] If fresh from the shower, wait until your hair mostly dries, about 15-20 minutes (30-45 minutes for thick hair). You may use a blow dryer to speed this up.', \\\"Otherwise, dampen your hair right at the roots; if you're not sure how to do it, you can either wet or spray water on your scalp instead. Then use your fingers to scrunch the hair back.\\\", 'This will allow your hair to stay damp while you scrunch it. [title] Once damp, separate your hair into three sections.', '[title] Once your hair is dampened, spritz some dampness from the ends with a diffuser or a spray bottle. [step] Consider leaving this on your hair for now, as it will get used to the warmth of the water and could become wet, but it will work for life.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}