{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bc451dfa-47f4-55e6-9bcc-0357b4d83e39","task_key":"default--validation--8131","task_revision_id":"1","upstream_id":"8131","short_description":"HellaSwag validation 8131","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to do a five minute sports hairstyle [title] Use this hairstyle if you have long hair. [step] If you have shorter hair, a classic bun will quickly become messy. [title] Run a smoothing serum through your hair.\",\"endings\":\"[\\\"[step] It helps prevent flyaways as well and it's natural for curly hair to grow. [title] Redo your hair, then flip it up and smooth it.\\\", \\\"[step] There are a lot of smoothing serums out there, but it doesn't really matter which one you buy. Get one that suits your hair type (this is usually written on the bottle), but don't worry too much about brand names.\\\", \\\"[step] This eases your hair's cuticles. You can either try cutting your hair into a bun or using a small amount of smoothing serum at the front and the back of your hair, and securing with hair clips.\\\", '[step] Simply use the ends of your hair, and because that is thinner and more natural looking, it will ensure that your hair is looking smooth and full. [title] Use your fingertips to apply your serum.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}