{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c1014ac1-b54a-5fd3-b071-d121b041efed","task_key":"default--validation--24523","task_revision_id":"1","upstream_id":"24523","short_description":"HellaSwag validation 24523","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to rid yourself of a bad perm [title] Use a good deep conditioner. [step] A deep conditioner will hydrate your permed hair, decrease frizziness, and make the perm look a bit better. [title] Apply waving lotion to straighten out the perm.\",\"endings\":\"[\\\"[step] This will help minimize frizziness while you're in the shower. [title] Comb or blow dry your hair before use.\\\", \\\"[step] Take it off when you're done with your hair, then let it sit for another 20 to 30 minutes at room temperature. [title] Use a hair blow dryer to blow dry the rest of your hair.\\\", '[step] This will also help keep the perm looking smooth. [substeps] Massage the lotion into your hair and your scalp, and then rinse it out.', \\\"[step] If you're looking to try to restyle the perm by straightening it, it's important to first deep condition your hair really well before applying any more heat to your hair. Do this the day before you plan to straighten your hair.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}