{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8ca83202-f86b-58de-8530-e8573a0df9d3","task_key":"default--validation--44647","task_revision_id":"1","upstream_id":"44647","short_description":"HellaSwag validation 44647","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use sea salt shimmer spray [title] Towel dry your hair gently. [step] Shimmer spray works well on wet hair, but you shouldn't use it on soaking wet hair. After you wash your hair in the shower, use an old t-shirt or a microfiber towel to squeeze the excess water out of it.\",\"endings\":\"[\\\"[substeps] Make sure that you don't submerge your head in the water during this step. It's ok if you smell bad before you begin this step, so long as it is really dried down.\\\", 'Then, starting at the roots and working your way down, use the towel to gently pat your hair. [substeps] Opt for a microfiber towel or old cotton t-shirt over a terrycloth towel.', 'Wring out the water, and rinse out the suds. Shake your head to ensure the water is rinsed away and your hair is completely dry.', 'Blow dry your hair dry using a colander. [title] Spray sea salt shimmer spray evenly through your hair.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}