{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d22d9810-c71f-52fb-896f-11745d1a63dc","task_key":"default--validation--38540","task_revision_id":"1","upstream_id":"38540","short_description":"HellaSwag validation 38540","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make a messy bun [title] Choose the perfect styling products. [step] The following is a quick list of things you may already have around your home. Even if you don't have these things, don't worry, the messy bun can be easily created with just your fingers and a rubber-band.\",\"endings\":\"['Avoid going to the consignment store or online, as the accessories will only cause unnecessary pain. Stick to the tool (s) you already have lying around the house.', 'It is also easy enough to find all of the following items at your local 24-hour drug store. If you are thinking of creating a messy bun for a more important event like a wedding or prom you can plan ahead and find a store that specializes in carrying hair care products and accessories.', \\\"Here's how to do it : [substeps] Wet your hair with lukewarm water and smooth a small amount of shampoo into your hands. Then grab a handful of the hair at the top of your head just above your ears, and secure it in with a rubber band.\\\", '[substeps] Shampoo: clean your hair before adding any styling products. Scrubbing the scalp with a washcloth for thirty seconds may be all you need to create a messy bun.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}