{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ed1707cd-aefd-53d4-b50e-298654a28c28","task_key":"default--validation--13432","task_revision_id":"1","upstream_id":"13432","short_description":"HellaSwag validation 13432","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to treat split ends [title] Use the right type of shampoo and conditioner. [step] Look for something that says restructuring, repairing, nourishing, hydrating, or moisturizing on the label. These types of shampoos and conditioners are designed to add extra moisture, proteins, and vitamins to your hair, making it healthier and stronger.\",\"endings\":\"['[substeps] Avoid anything that says \\\" small \\\" on the label, as this can indicate the ingredients are less nourishing than their close counterparts. Hold the container under running water and use warm water to wash your hair.', \\\"They won't necessarily seal the split ends back up, but they will help manage them and prevent the split from going further up the hair shaft. [title] Use a deep-conditioning hair mask.\\\", 'Most shampoos and conditioners are heat-activated. These are not intended to be applied to wet hair.', 'Apply the shampoos and conditioners regularly, and wash your hair as you regularly would when you split it up. [substeps] If you shampoo your hair twice weekly, you should invest in a shampoo specifically formulated for split ends.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}