{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9431c441-2294-5a54-b3ed-ed4407de97a3","task_key":"default--validation--20093","task_revision_id":"1","upstream_id":"20093","short_description":"HellaSwag validation 20093","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to style wavy frizzy hair [title] Use a moisturizing shampoo and conditioner. [step] If you have naturally wavy and frizzy hair, then using the right shower products is very important. Look for a shampoo or conditioner that advertises its moisturizing qualities.\",\"endings\":\"['Make sure to massage these products into your scalp while taking a shower and fully rinse them out. [substeps] You can also comb your conditioner through your hair while taking a shower.', 'Make sure that it is water-based, and not shampoo containing sugar. It can make the detangling process time quicker, too.', 'A good moisturizing shampoo and conditioner might include : [substeps] Baby-friendly look: the jet-stream shampoo made of water and honey. Dove hair: the hydrating shampoo specifically designed for curly hair.', \\\"Remember that there are shampoos and conditioners meant to keep your hair moisturized and healthy. Ideally, use the spray or gel combination that's included in the kit.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}