{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e3463e29-759e-5d2f-9ef9-e5b8e36c0875","task_key":"default--validation--29531","task_revision_id":"1","upstream_id":"29531","short_description":"HellaSwag validation 29531","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to be a subtly sexy teen [title] Keep yourself clean. [step] You can't be sexy if you smell bad and have greasy hair. Use a good cleansing shampoo, and a hydrating conditioner.\",\"endings\":\"[\\\"When you shower, rinse your hair well with warm water and then dry your hair completely. Girls who aren't clean want to smell and want to feel good, so keeping your hair clean is key.\\\", \\\"[title] Take a shower when you've got it and brush your hair. [step] Don't go looking bad; just look natural! Don't put shampoo into your hair when it's damp because it dries you out quicker and your hair is harder to grow back.\\\", 'Shampoo gently but firmly, and wash your hair thoroughly. [substeps] If your hair is greasy, use a natural body wash.', 'Leave the conditioner in for about a minute, and shampoo twice if you have naturally oily hair. Shave your legs, under arms, and bikini line everyday.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}