{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8278d8df-e85f-56ab-ad27-069ba1c6e01c","task_key":"default--validation--5301","task_revision_id":"1","upstream_id":"5301","short_description":"HellaSwag validation 5301","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to cut a girl's hair [title] Start with washed hair. [step] The hair should be clean and damp when cutting. After the hair is washed, towel dry it to remove excess water, and then brush out any knots.\",\"endings\":\"['[substeps] You can cut your hair straight or down. Your preference will be whatever looks best for you.', \\\"[substeps] If you've already washed your hair, the gentle cycle will give you no qualms. If you feel your hair is too wet and needs to be gentle, consider letting it air dry.\\\", '[substeps] Brush from the ends, and work your way up to the root to work out knots. This will prevent damage to the hair and will put less strain on the scalp.', 'Then apply conditioner and finish by misting the hair with a diffuser to encourage the roots to move. [substeps] Avoid using shampoo or conditioner that can stain wet hair.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}