{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"94965e47-717d-5f52-bd2c-73f07121ace9","task_key":"default--validation--4901","task_revision_id":"1","upstream_id":"4901","short_description":"HellaSwag validation 4901","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to plop your hair [title] Shampoo and condition your hair. [step] The plopping method requires damp hair, so it's best to do it right after you take a shower. Use your favorite shampoo and conditioner, ensuring that your hair is nice and clean.\",\"endings\":\"[\\\"[substeps] If you have deep colors or are pale in color, use this method. If you're blonde or very light-haired, your hair will look frizzy after rinsing.\\\", '[substeps] If you want your hair wrapped up overnight, take a shower before going to bed. [title] Scrunch out excess water from your hair after showering.', \\\"Once you've showered, comb out and then apply conditioner. Shake off the conditioner and towel dry your hair.\\\", \\\"After you've washed your hair, your hair can just settle back into the style you've created. You don't want it damp all day, or you could get sunburn.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}