{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"be42e290-61b5-5dc3-a13f-7cb698f9f4df","task_key":"default--validation--13923","task_revision_id":"1","upstream_id":"13923","short_description":"HellaSwag validation 13923","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to deal with frizzy hair [title] Wash your hair only a few times a week. [step] Your hair usually becomes frizzy because it's dry, and shampooing too often can dehydrate it even further. Instead of washing your locks every day, limit it to every other day or less if you can.\",\"endings\":\"['Washing your hair at least once a week is good. [substeps] Try to use shampoo and conditioner when you wash it.', '[substeps] If your roots are starting to look a little greasy in between washes, use a dry shampoo product to help soak up the excess oil. It can also help boost volume and texture if your hair is looking a little flat.', '[substeps] Make sure your hair is under running water at least once a week. That way you can wash it at a time that works for you.', '[substeps] You can take a shower before and after you wash your hair to prevent dry frizziness from building up. [title] Rinse your hair as you normally would.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}